Sequential models are not allowed to quantize l.How can I quantize a custom model?
The Dynamic Quantization on an LSTM Word Languange Model or the Static Quantization with Eager Mode tutorials might be a good starter.
The first tutorial seems to use a custom model, which seems to fit your use case.