Quantization on trained model weights

I would like to apply quantization on trained model weights, could you please tell, how to alter the weights of the transformer model and update weights.

I have implemented the transformer model as an example specified in the page https://pytorch.org/tutorials/beginner/transformer_tutorial.html