Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

978

Base only

Active filters: 4bit

TracNetwork/Qwen3.5-4B-4bit-mlx

Image-Text-to-Text • 1.0B • Updated Mar 4 • 25

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 18 days ago • 1.48k • 21

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated 18 days ago • 1.27k • 12

avnishrai1/qwen3.5-4b-gguf

Text-to-Image • 4B • Updated Mar 4 • 1.23k

mehta7408/qlora-mistral-green-patent

Text Generation • Updated Mar 5 • 1

JongYeop/Llama-3.1-70B-Instruct-MXFP4-W4A4

Text Generation • 38B • Updated Mar 5 • 7

JongYeop/Mistral-7B-Instruct-v0.2-MXFP4-W4A4

Text Generation • 4B • Updated Mar 5 • 14

JongYeop/Qwen2.5-3B-Instruct-MXFP4-W4A4

Text Generation • 2B • Updated Mar 5 • 6

JongYeop/Qwen2.5-14B-Instruct-MXFP4-W4A4

Text Generation • 9B • Updated Mar 5 • 7

manu02/zembed-1-bnb-4bit-nf4-dq

Text Generation • 4B • Updated Mar 5 • 15 • 1

aab20abdullah/medgemma-1.5-4b-it-4bit-nf4

4B • Updated Mar 6 • 10

suedegambit/Gemma-3-27B-it-NP-Abliterated-GPTQ-INT4-128g

Image-Text-to-Text • 5B • Updated Mar 9 • 14

runanywhere/qwen3_0.6B_MLX_4bit

Updated Mar 12 • 10

runanywhere/qwen3_4B_mlx_4bit

Updated Mar 12 • 6

runanywhere/Llama_32_3B_4bit

Updated Mar 12 • 7

henrybravo/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated Mar 12 • 9

runanywhere/whisper_small_4bit

Updated Mar 12 • 18

runanywhere/whisper_medium_4bit

Updated Mar 12 • 18

bmeyer2025/qmd-query-expansion-qwen3.5-2B-mlx-4bit

Text Generation • 0.3B • Updated Mar 10 • 67 • 1

vanch007/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-mlx-4bit

Image-Text-to-Text • 5B • Updated Mar 18 • 138 • 3

machinadeusex/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated Mar 14 • 45 • 1

Sepolian/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M

Text Generation • 27B • Updated Mar 15 • 202 • 15

Durindragon/Impish_Bloodmoon_12B_Abliterated-EXL3-4bit

Text Generation • 4B • Updated Mar 15 • 9

AITRADER/Amsi-fin-o1.5-mxfp4-MLX

Image-Text-to-Text • 2B • Updated Mar 16 • 9

mlx-community/bge-m3-mlx-4bit

Feature Extraction • 89M • Updated Mar 16 • 566

vanch007/Huihui-Qwen3.5-4B-Claude-4.6-Opus-abliterated-mlx-4bit

Image-Text-to-Text • 1.0B • Updated Mar 18 • 38

vanch007/Huihui-Qwen3.5-9B-abliterated-mlx-4bit

Image-Text-to-Text • 2B • Updated Mar 18 • 153

Thump604/Qwen3.5-4B-MLX-4bit

1.0B • Updated Apr 2 • 19

groxaxo/Qwen3.5-27B-heretic-v2-autoround-w4a16

Image-Text-to-Text • 3B • Updated Mar 29 • 5 • 1

groxaxo/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic-v2-AutoRound-W4A16

Image-Text-to-Text • 3B • Updated Mar 17 • 8 • 2