How to use a huge line corpus (text) with Dataset/DataLoader?

nlp
10

Also I found a pretty fast solution here in case anyone has the same problem.