I have found an issue closed to support 4-bit quantization although it’s not officially described in the doc.
model-compiler seems not to support
model-compiler: for the -quantization-precision option: Cannot find option named 'Int4'!
We want to try this quantization mode. It is available in the latest Glow? How can we use that?