Hugging Face's logo

ruikangliu
/
DeepSeek-R1-Distill-Qwen-32B-quantized.awq-autoawq-w4g128

Safetensors
qwen2
4-bit precision
awq
Model card Files
xet
Community

Quantized model from Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models.

Downloads last month
7
Safetensors
Model size
6B params
Tensor type
I32
·
BF16
·
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ruikangliu/DeepSeek-R1-Distill-Qwen-32B-quantized.awq-autoawq-w4g128