PyTorch Forums
How tokens per second calculated for LLM training
nlp
bigtree
(bigtree)
September 18, 2024, 5:45am
1
how are tokens per second calculated for LLM training? Is this the same way as for LLM inference?