Can I input a Byte Tensor to my RNN/LSTM model?

I am developing an RNN/LSTM model to which I want to encode the sequence in a ByteTensor to save memory as I am limited to a very tight memory. However, when I do so, the model returns the following error:

Expected object of scalar type Byte but got scalar type Float for argument #2 ‘mat2’

So, there seems to be something else that is need to be Byte tensor as well, but I do not know what is it since the console only shows an error at the line:

output = model(predictor)