|
Switch loss function causes "RuntimeError: Found dtype Double but expected Float"
|
|
6
|
1907
|
April 24, 2025
|
|
How to quantize my torchscript to fp8
|
|
1
|
397
|
April 18, 2025
|
|
Loss stuck at quantization aware training for 16bits
|
|
1
|
74
|
April 18, 2025
|
|
Question about quantized model save & load
|
|
5
|
245
|
April 18, 2025
|
|
Quantization method diff between fake quant and true quant
|
|
1
|
106
|
April 14, 2025
|
|
Right way to insert QuantStub and DeQuantStub in eager mode quantization
|
|
6
|
235
|
April 12, 2025
|
|
QAT model is not performing as expected when compared to the original model
|
|
7
|
234
|
April 9, 2025
|
|
Can't get dynamic shape with torch.export.export_for_training
|
|
3
|
415
|
April 8, 2025
|
|
The code aims to collect data about SiLU (Sigmoid Linear Unit) activation layers in a quantized YOLOv5 model. Specifically, it: Creates a custom SiLUDataCollector to replace SiLU layers Captures quantization parameters (scale and zero point) Saves quanti
|
|
1
|
106
|
April 6, 2025
|
|
How to custom a quantizar using fx
|
|
1
|
73
|
April 6, 2025
|
|
Question on quantize_per_channel and dequantize
|
|
5
|
229
|
April 6, 2025
|
|
Quantized LLM inference vs quantized matrix multiplication speed in CPU
|
|
2
|
152
|
April 6, 2025
|
|
Quantization fails for custom backend
|
|
3
|
291
|
March 21, 2025
|
|
Simulating quantization to lower bit precision with quant_min/max setting on fused modules
|
|
0
|
86
|
March 19, 2025
|
|
Help Needed: High Inference Time & CPU Usage in VGG19 QAT model vs. Baseline
|
|
0
|
71
|
March 15, 2025
|
|
Is dynamic quantization in fact doing weight dequant instead of activation quant for `quantize_dynamic()`
|
|
1
|
154
|
March 13, 2025
|
|
Trying to Understand the Scale Computation During Static Quantisation
|
|
0
|
94
|
March 2, 2025
|
|
Exclude specific layers from quantization
|
|
1
|
170
|
February 24, 2025
|
|
Questions on QAT for Wav2Vec
|
|
3
|
311
|
February 24, 2025
|
|
"Deploy Quantized Models using Torch-TensorRT" failed
|
|
5
|
387
|
February 18, 2025
|
|
Additional layer in the conv weight after quantization
|
|
1
|
301
|
February 15, 2025
|
|
Compatibility Issue: Wav2Vec2 QAT with PyTorch 2 Export
|
|
1
|
215
|
February 13, 2025
|
|
Quantized::linear (xnnpack): xnn create operator failed(2)
|
|
1
|
200
|
February 12, 2025
|
|
JIT model is a deployment model or a quantized model?
|
|
0
|
78
|
February 7, 2025
|
|
How to customize a quantization algorithm and deploy it?
|
|
2
|
125
|
February 5, 2025
|
|
USing Quantization tutorial,but the result different
|
|
2
|
112
|
February 4, 2025
|
|
Data types on quantized models
|
|
0
|
163
|
February 4, 2025
|
|
Custom weight observer for powers of 2
|
|
2
|
894
|
January 29, 2025
|
|
Run quantized model on GPU
|
|
2
|
2435
|
January 23, 2025
|
|
Quantization of depthwise 1d convolution with QAT is slower than non-quantized
|
|
2
|
276
|
January 23, 2025
|