Hi! I meet this and meet a bug called:
Could anyone kindly help me? Thank you!!!
PatchEmbeddingSTD is causing the error as apparently its
.weight attribute is missing while a module expects it. Could you check where this module is coming from and how its
self.weight attribute is initialized and used?
I have printed all the parameters out:
For FSDP, it shows only(!) this:
I am thinking maybe FSDP itself has some problem? Maybe it does not support embedding?
@Yanli_Zhao could you please take a look?