Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

210

Full-text search

Active filters: fp_quant

daslab-testing/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4-200steps

Text Generation • 5B • Updated Aug 11 • 2

daslab-testing/Qwen3-1.7B-FPQuant-QAT-NVFP4-200steps

Text Generation • 1B • Updated Aug 11 • 11

daslab-testing/Qwen3-1.7B-FPQuant-QAT-NVFP4-1000steps

Text Generation • 1B • Updated Aug 11 • 11

daslab-testing/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4-600steps

Text Generation • 5B • Updated Aug 11 • 2

daslab-testing/Qwen3-1.7B-FPQuant-QAT-NVFP4-1400steps

Text Generation • 1B • Updated Aug 11 • 11

daslab-testing/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4-200steps

Text Generation • 2B • Updated Aug 11 • 2

daslab-testing/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4-1000steps

Text Generation • 5B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4-600steps

Text Generation • 2B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4-1000steps

Text Generation • 2B • Updated Aug 11 • 2

daslab-testing/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4-1400steps

Text Generation • 5B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4-1400steps

Text Generation • 2B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4-200steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4-600steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4-200steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4-1000steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4-600steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4-1400steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4-1000steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-RTN-NVFP4

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4-1400steps

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-1B-Instruct-FPQuant-RTN-MXFP4

Text Generation • 0.8B • Updated Aug 11 • 2

daslab-testing/Llama-3.2-3B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform

2B • Updated Sep 1 • 1

daslab-testing/Llama-3.2-1B-Instruct-nvfp-w4-a4-GPTQ-hadamard-transform

0.8B • Updated Aug 12

daslab-testing/Llama-3.2-1B-Instruct-mxfp-w4-a4-GPTQ-hadamard-transform

0.8B • Updated Aug 12

daslab-testing/Llama-3.2-1B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform

0.8B • Updated Aug 12 • 1

daslab-testing/Llama-3.2-3B-Instruct-nvfp-w4-a4-GPTQ-hadamard-transform

2B • Updated Aug 12 • 1

daslab-testing/Llama-3.2-3B-Instruct-mxfp-w4-a4-GPTQ-hadamard-transform

2B • Updated Aug 12

daslab-testing/Llama-3.2-3B-Instruct-FPQuant-RTN-MXFP4

Text Generation • 2B • Updated Aug 12 • 1

daslab-testing/Llama-3.2-3B-Instruct-FPQuant-RTN-NVFP4

Text Generation • 2B • Updated Aug 12 • 2

daslab-testing/Llama-3.2-3B-Instruct-FPQuant-QAT-MXFP4-1400steps

Text Generation • 2B • Updated Aug 12 • 2