LLM and generation are hot topics recently. I tried looking for official tutorials, examples of LLM, LoRA, GPT… on the Pytorch homepage but there was nothing.
The Pytorch blog has updated information about LLM but it is a ‘blog’:
Perhaps I was flawed in my search for information.
Do you have any official documents or plans for LLM and generative?
It comes in various sizes. What you’ll probably want to do is get a pretrained set of weights and finetune a set of LoRA vectors ontop of those. Assuming your use case is in English.
Your GPU size will determine which model want to use.