When training with FSDP, optimizer_0 and pytorch_model_fsdp_0 directories are created. How do I extract model.bin and config.json files from them?
The file structure is as follows.
├── pytorch_model_fsdp_0/
│ ├── __0_0.distcp
│ └── __1_0.distcp
└── .metadata
│
├── optimizer_0/
│ ├── __0_0.distcp
│ └── __1_0.distcp
└── .metadata
├── scheduler.pt
├── trainer_state.json