Hi! I meet this and meet a bug called:
Could anyone kindly help me? Thank you!!!
It seems PatchEmbeddingSTD
is causing the error as apparently its .weight
attribute is missing while a module expects it. Could you check where this module is coming from and how its self.weight
attribute is initialized and used?
I have printed all the parameters out:
For FSDP, it shows only(!) this:
I am thinking maybe FSDP itself has some problem? Maybe it does not support embedding?
Thank you!!!