Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

198

Base only

Active filters: hqq

brunopio/Qwen2.5-7B-Instruct-1M-nbits4-GS64-Axis1-HQQ-T

5B • Updated Feb 13, 2025 • 4

brunopio/Qwen2.5-7B-Instruct-1M-nbits4-GSNone-Axis0-HQQ-T

4B • Updated Feb 13, 2025 • 2

brunopio/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-nbits4-GS64-Axis1-HQQ-T

1B • Updated Feb 13, 2025 • 2

brunopio/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-nbits4-GSNone-Axis0-HQQ-T

1B • Updated Feb 13, 2025 • 4

brunopio/Qwen2.5-Coder-0.5B-Instruct-abliterated-nbits4-GS64-Axis1-HQQ-T

0.3B • Updated Feb 13, 2025

brunopio/Qwen2.5-Coder-0.5B-Instruct-abliterated-nbits4-GSNone-Axis0-HQQ-T

0.3B • Updated Feb 13, 2025

jpablomch/Meta-Llama-3-8B-Instruct-hqq

Text Generation • 8B • Updated Feb 14, 2025 • 5

answerdotai/Qwen2.5-Coder-14B-hqq-hf

8B • Updated Feb 21, 2025 • 4

answerdotai/Qwen2.5-Coder-1.5B-hqq-hf

1B • Updated Feb 21, 2025 • 2

TeeZee/Lumimaid-v0.2-8B-4bit-64g-hqq

5B • Updated Mar 24, 2025 • 1

dropbox-dash/Qwen2.5-VL-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Apr 23, 2025 • 11 • 1

dropbox-dash/Qwen2.5-VL-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Apr 23, 2025 • 4 • 1

dropbox-dash/Qwen2-VL-2B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Apr 22, 2025 • 2 • 1

Erland/softpick-340M-4096-model-HQQ-2bit

Text Generation • Updated Apr 24, 2025 • 4

Erland/vanilla-340M-4096-model-HQQ-2bit

Text Generation • Updated Apr 24, 2025 • 4

Erland/softpick-340M-4096-model-HQQ-3bit

Text Generation • Updated Apr 24, 2025

Erland/vanilla-340M-4096-model-HQQ-3bit

Text Generation • Updated May 29, 2025

ArtusDev/Qwen3-32b_8bitgs128_hqq

Text Generation • 33B • Updated May 12, 2025 • 1

ArtusDev/Qwen3-32b_8bitgs64_hqq

Text Generation • 34B • Updated May 12, 2025 • 1

ArtusDev/Qwen3-32b_4bitgs64_hqq

Text Generation • 18B • Updated May 12, 2025 • 1

Erland/softpick-1.8B-4096-model-HQQ-2bit

Text Generation • Updated May 29, 2025 • 4

Erland/softpick-1.8B-4096-model-HQQ-3bit

Text Generation • Updated May 29, 2025 • 1

Erland/vanilla-1.8B-4096-model-HQQ-2bit

Text Generation • Updated May 29, 2025 • 4

Erland/vanilla-1.8B-4096-model-HQQ-3bit

Text Generation • Updated May 29, 2025 • 2

Cloudmaster/Llama-3.2-3B-HF-hqq-00

Text Generation • 2B • Updated May 28, 2025 • 4

Cloudmaster/Llama-3.2-3B-HF-hqq-01

Text Generation • 2B • Updated May 28, 2025 • 4

Cloudmaster/Llama-3.2-3B-HF-hqq-02

Text Generation • 2B • Updated May 28, 2025 • 5 • 1

Cloudmaster/Llama-3.2-3B-HF-hqq-03

Text Generation • 2B • Updated May 28, 2025 • 5

Cloudmaster/Llama-3.2-3B-HF-hqq-04

Text Generation • 3B • Updated May 29, 2025 • 5

Cloudmaster/Llama-3.2-3B-HF-hqq-05

Text Generation • 3B • Updated May 29, 2025 • 5