How to use a huge line corpus (text) with Dataset/DataLoader?

nlp
2

Have a look at this small example using a pd.DataFrame to read small chunks of data.
Let me know, if that works for you.