Difference between Vocab and vocab

mmg · June 20, 2021, 5:48pm

Does anyone know the difference between torchtext.vocab.Vocab and torchtext.vocab.vocab?

All I know is that I can’t pass the min_freq parameter to the *.Vocab.

pascal_notsawo · June 20, 2021, 8:50pm

torchtext.vocab.Vocab is a class while torchtext.vocab.vocab is a method that returns an object of type torchtext.vocab.Vocab.

github.com

pytorch/text/blob/master/torchtext/vocab.py#L225-L230

    
      
          tokens = []
          for token, freq in ordered_dict.items():
              if freq >= min_freq:
                  tokens.append(token)
          
          
return Vocab(VocabPybind(tokens, None))

A bit like tensor and Tensor.