I’ve been trying to implement dynamic quantization for the past two days. I’ve spent all my days and nights trying to solve the problem on my own, but now I’ve dropped my guns — so here I am.
There used to be a function in PyTorch for dynamic quantization called quantize_dynamic. However, it has been deprecated, and the entire quantization library has been moved to torchao, where I couldn’t find anything helpful.
Can anyone please help me with this? I’d really appreciate it.
Thanks in advance!