How I can set the values the LSTM hidden state can take, so they are from -x to x, where x is a float and the distribution is uniform? The exact same thing for nn.Embedding
can be achieved as it follows:
initrange = 0.5 / 100
embeddings.weight.data.uniform_(-initrange, initrange)