Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

86

Full-text search

Active filters: sparsity

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 1

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 4 • 1

RedHatAI/Sparse-Llama-3.1-8B-2of4

Text Generation • 8B • Updated Dec 16, 2024 • 67 • 62

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 2 • 3

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4

Text Generation • 8B • Updated Nov 21, 2024 • 5 • 1

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4

Text Generation • 8B • Updated Nov 21, 2024 • 1 • 1

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 2

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 2

bartowski/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Nov 26, 2024 • 1.09k • 3

QuantFactory/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Nov 27, 2024 • 192 • 4

tensorblock/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Jul 9 • 97

nintwentydo/pixtral-12b-2409-2of4-sparse

Image-Text-to-Text • 13B • Updated Jan 5 • 1

HangGuo/Llama2-70B-QuaRot-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated Sep 26 • 23 • 1

HangGuo/Llama2-70B-QuaRot-OBR-RTN-W4A4KV4S50

Text Generation • Updated Sep 26 • 12

HangGuo/Llama2-70B-SpinQuant-OBR-RTN-W4A4KV4S50

Text Generation • Updated Sep 26 • 3

HangGuo/Llama2-70B-SpinQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated Sep 26 • 3

HangGuo/Llama3-70B-SpinQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated Sep 26 • 3

HangGuo/Llama3-70B-SpinQuant-OBR-RTN-W4A4KV4S50

Text Generation • Updated Sep 26 • 4

HangGuo/Llama3-70B-QuaRot-OBR-RTN-W4A4KV16S50

Text Generation • Updated Sep 26 • 11

HangGuo/Llama3-70B-QuaRot-OBR-GPTQ-W4A4KV16S50

Text Generation • Updated Sep 26 • 11

HangGuo/QWen2.5-7B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated Sep 26 • 9

HangGuo/QWen2.5-32B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated Sep 26 • 8

HangGuo/QWen2.5-1.5B-FlatQuant-OBR-GPTQ-W4A8KV16S50

Text Generation • Updated Sep 26 • 6

HangGuo/QWen2.5-3B-FlatQuant-OBR-GPTQ-W4A8KV16S50

Text Generation • Updated Sep 26 • 14

HangGuo/QWen2.5-3B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated Sep 26 • 10

HangGuo/QWen2.5-1.5B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated Sep 26 • 3