How to quantize a model with both CNN and LSTM

[jerryzh168 (Jerry Zhang)]

@Nanton

If there is a model with CNN as backbone, LSTM as its head, how to quantize this whole model with post training quantization? It seems we can apply static quantization to CNN and dynamic quantization to LSTM( Quantization — PyTorch 1.12 documentation ). But not very sure how to deal with cases like above one.

we don’t have a tutorial yet. Are you using eager mode quantization? if so LSTM is supported by default, you can follow the original flow: (beta) Static Quantization with Eager Mode in PyTorch — PyTorch Tutorials 2.1.1+cu121 documentation

fx graph mode quantization is not fully supporting static quantization for LSTM yet I think