ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4
0.8B
•
Updated
•
27
FP-Quant QAT
High-quality QAT FP4 models to use with the fp_quant vLLM/Transformers integration on Blackwell NVIDIA GPUs. See https://arxiv.org/abs/2509.23202
-
-
ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4
0.8B • Updated • 22 -
ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4
2B • Updated • 28 -
ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-MXFP4
2B • Updated • 27 -
ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4
5B • Updated • 43 -
ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-MXFP4
5B • Updated • 38 -
ISTA-DASLab/Qwen3-0.6B-FPQuant-QAT-NVFP4
Text Generation • 0.4B • Updated • 27 -
ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4
Text Generation • 1B • Updated • 16 -
ISTA-DASLab/Qwen3-4B-FPQuant-QAT-NVFP4
Text Generation • 2B • Updated • 20 -
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4
5B • Updated • 31 -
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-MXFP4
5B • Updated • 58