Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

210

Base only

Active filters: hqq

deng8470/FLUX.1-t5-xxl-HQQ-int8

5B • Updated Oct 31, 2025 • 21 • 1

AlekseyCalvin/FLUX2_dev_2bit_hqq

Image-to-Image • 9B • Updated Nov 27, 2025 • 13 • 5

jjunghey/Llama-3.2-1B-TinyStories-HQQ

0.8B • Updated Dec 19, 2025 • 34

rahim-xelpmoc/xclip-base-patch16-zero-shot-hqq-4bit

Feature Extraction • 0.1B • Updated Jan 29 • 11

BondingAI/Qwen2.5-0.5B-hqq-4bit

Updated Feb 24 • 3

cosail-knu/llama2-2.7b_8

3B • Updated Mar 3 • 5

cosail-knu/pythia-2.8b_8

3B • Updated Mar 9 • 5

daksh-neo/sarvam-30b-quantized

Text Generation • 32B • Updated Mar 14 • 32

SocialLocalMobile/Qwen3.5-35B-A3B-HQQ-INT4

Image-Text-to-Text • 17B • Updated Mar 24 • 759

tiggychan/gemma-4-E2B-it-uncensored-mnn-int4

Text Generation • Updated Apr 13 • 21 • 1

tiggychan/gemma-4-E4B-it-uncensored-mnn-int4

Text Generation • Updated Apr 13 • 53 • 1

decompute/Nebula-S-v1-lite

Text Generation • Updated Apr 16 • 26

SocialLocalMobile/Qwen3.6-35B-A3B-HQQ-INT4

Image-Text-to-Text • 20B • Updated Apr 17 • 22

decompute/Nebula-S-v1-4bit-optimized

Text Generation • Updated Apr 16 • 14

Azaz666/SmolVLM-256M-Instruct-HQQ-INT4-v2

Updated Apr 27 • 4

SocialLocalMobile/gemma-4-31B-it-HQQ-INT4

Image-Text-to-Text • 21B • Updated May 5 • 16

jngb-labs/gemma4-E2B-text-3bit

Text Generation • 3B • Updated May 28 • 8

prism-ml/bonsai-image-binary-4B-gemlite-1bit

Text-to-Image • Updated Jun 1 • 98 • 51

cocxxe/bonsai-image-ternary-4B-gemlite-2bit

Text-to-Image • Updated Jun 2 • 1

Lotaliz/Qwen3-1.7B-hqq-int4

2B • Updated Jun 9 • 4

Lotaliz/Llama-3.2-3B-Instruct-hqq-int4

3B • Updated Jun 9 • 4

gabe-engineers/bonsai-image-ternary-4B-gemlite-2bit

Text-to-Image • 1B • Updated Jul 23 • 6

lhabacuc/bonsai-image-ternary-4B-gemlite-2bit

Text-to-Image • Updated Jun 27 • 1

gabe-engineers/bonsai-image-ternary-4B-gemlite-2bit-unpacked-encoder

Text-to-Image • 1B • Updated Jul 25 • 6

forjadai/bonsai-image-ternary-4B-gemlite-2bit

Text-to-Image • Updated Jul 24 • 1

dkhokhlov/whisper-tiny-hqq-4bit

Automatic Speech Recognition • 35.3M • Updated Aug 10 • 9

dkhokhlov/whisper-base-hqq-4bit

Automatic Speech Recognition • 65.9M • Updated Aug 10 • 17

dkhokhlov/whisper-small-hqq-4bit

Automatic Speech Recognition • 0.2B • Updated Aug 10 • 12

LayerNorm/Qwen3-ASR-0.6B-hf-hqq-int4

Automatic Speech Recognition • 0.5B • Updated about 1 month ago • 10

mesmertech/Breeze-TTS-2-int4-hqq-g64

Text-to-Speech • 3B • Updated 22 days ago • 120 • 1