Llearning to write and train GPT in PyTorch?

nlp
1

Is there any recommended Tutorial that I could take to learn how to write simple gpt architectures using pythorch and could be trained in a standard Laptop?

2

Maybe this notebook and this notebook could be useful.

1 Like
3

This youtube video from Andrej Karpathy is good. If you find it hard to understand definitely you can start watching the makemore series.

1 Like