Finen tuning Llama with using pytorch in colab

Hello. Im having an issue with fine tuning Llama 3.1. Google cloab crashes whenever I try to train on my custom dataset. I think its about pytorch and tensorflow versions. Im tried to use gpu and tpu both gave me error. And the memory not working when I start the train my model.Already thx a lot…

1 Like

Could you provide the exact error if possible? Maybe a colab timeout.