How to delete last linear layer of ViT-H or how to replace it with Identity()?

vision
1

Hello there! I’m trying to figure out how I could possibly replace or delete the last layer of VIT-H or ViT-b.
Here deleting children method doesn’t work like Resnet.

Screenshot 2023-08-17 at 6.34.05 PM
Screenshot 2023-08-17 at 6.34.05 PM1595×1285 342 KB

Thanks in advance for the suggestion!

2

looking for an answer!

3

You can directly replace layers with an nn.Identity module.
I would also not recommend bumping the thread after 2h of wait time, as it’s just spamming the board and not helpful.

4

I can access to model.encoder layers. But I didn’t find any solution how to access the last linear layer in VIT!