Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,826

Base only

Active filters: 2-bit

blockblockblock/Gemma-4-31B-StyleTune-exl3-2.5bpw

Text Generation • 7B • Updated Jun 14 • 11

usermma/Wicked-Moondust-12B-mlx-2Bit

Text Generation • 1B • Updated Jun 14 • 40

Vishva007/Qwen3.5-4B-W2A16-AutoRound

1B • Updated Jun 14 • 7

Vishva007/Qwen3.5-4B-W2A16-AutoRound-GPTQ

5B • Updated Jun 14 • 6

Vishva007/Qwen3.5-9B-W2A16-AutoRound

2B • Updated Jun 14 • 130

Vishva007/Qwen3.5-9B-W2A16-AutoRound-GPTQ

2B • Updated Jun 14 • 25

rbinrs/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 14 • 892 • 2

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 775 • 6

kavenmartinez/Qwen3.6-27B-IQ2_XXS-webgpu-GGUF

Text Generation • 27B • Updated Jun 15 • 28

hyperspaceai/diffusiongemma-26B-A4B-asym-2bitexp-GGUF

Text Generation • 25B • Updated Jun 15 • 168 • 3

hyperspaceai/Qwen3-Coder-30B-A3B-asym-2bitexp-GGUF

Text Generation • 31B • Updated Jun 15 • 23 • 1

hyperspaceai/Qwen3-30B-A3B-Instruct-2507-asym-2bitexp-GGUF

Text Generation • 31B • Updated Jun 15 • 15

hyperspaceai/GLM-4.7-Flash-asym-2bitexp-GGUF

30B • Updated Jun 15 • 20

usermma/FastContext-1.0-4B-RL-mlx-2Bit

Text Generation • 0.4B • Updated Jun 15 • 7

usermma/FastContext-1.0-4B-SFT-mlx-2Bit

Text Generation • 0.4B • Updated Jun 15 • 5

usermma/Darwin-28B-REASON-mlx-2Bit

Text Generation • 27B • Updated Jun 15 • 9

usermma/vintage-LLM-340m-v1-base-mlx-2Bit

Text Generation • 32M • Updated Jun 15 • 7

usermma/EvoQuality-mlx-2Bit

Image-Text-to-Text • 0.7B • Updated Jun 15 • 5

usermma/VISTA-4B-mlx-2Bit

Image-Text-to-Text • 0.4B • Updated Jun 16 • 4

usermma/Baguettotron-mlx-2Bit

Text Generation • 30.2M • Updated Jun 16 • 4

usermma/Apodex-1.0-0.8B-SFT-mlx-2bit

Text Generation • 71M • Updated Jun 16 • 5

usermma/Qwable-9B-Claude-Fable-5-mlx-2Bit

Text Generation • 0.8B • Updated Jun 16 • 200 • 1

usermma/Vibe-Coding-Claude-Fable-5-mlx-2Bit

Text Classification • 0.7B • Updated Jun 16 • 37

usermma/fable-gpt-4b-mlx-2bit

Image-Text-to-Text • 0.4B • Updated Jun 16 • 43

usermma/ShellWhisperer-1.5B-mlx-2Bit

Text Generation • 0.1B • Updated Jun 16 • 5

usermma/UserLM-8b-mlx-2Bit

Text Generation • 0.8B • Updated Jun 16 • 7

usermma/VISTA-9B-mlx-2Bit

Image-Text-to-Text • 0.8B • Updated Jun 16 • 5

usermma/Apodex-1.0-4B-SFT-mlx-2Bit

Text Generation • 0.4B • Updated Jun 16 • 4

usermma/Apodex-1.0-2B-SFT-mlx-2Bit

Text Generation • 0.2B • Updated Jun 16 • 7

usermma/Apodex-1.0-mini-mlx-2Bit

Text Generation • 35B • Updated Jun 16 • 5