Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

343

Base only

Active filters: draft-model

deepsweet/Qwen3.6-27B-DFlash-FP16

Text Generation • 2B • Updated May 10 • 100 • 8

Ardenzard/Qwen3.6-27B-DFlash-GGUF

Text Generation • 2B • Updated Apr 28 • 748 • 11

z-lab/gemma-4-26B-A4B-it-DFlash

Text Generation • 0.4B • Updated May 9 • 4.49k • 56

z-lab/gemma-4-31B-it-DFlash

Text Generation • 2B • Updated May 8 • 21.4k • 105

abhinand/Qwen3.6-35B-A3B-DFlash-GGUF

Text Generation • 0.5B • Updated May 1 • 1.14k • 8

unieai/Qwen3.6-35B-A3B-DFlash

Text Generation • 0.5B • Updated Apr 26 • 10

unieai/Qwen3.5-4B-DFlash

Text Generation • 0.5B • Updated May 4 • 22

unieai/Qwen3.5-9B-DFlash

Text Generation • 1B • Updated May 4 • 12

unieai/Qwen3.5-35B-A3B-DFlash

Text Generation • 0.5B • Updated May 4 • 11

unieai/Qwen3-Coder-Next-DFlash

Text Generation • 0.5B • Updated May 4 • 11

z-lab/MiniMax-M2.7-DFlash

Text Generation • 0.6B • Updated Jun 25 • 306 • 26

Lucebox/Qwen3.6-27B-DFlash-GGUF

2B • Updated May 28 • 6.2k • 14

weijiezz/SpecBlock-Qwen3-8B

0.7B • Updated May 11 • 10 • 1

weijiezz/SpecBlock-Llama-3.1-8B-Instruct

0.7B • Updated May 11 • 12

weijiezz/EAGLE3-Llama-3.1-8B-Instruct

0.4B • Updated May 11 • 21

shdennlin/gemma-4-26B-A4B-it-assistant-8bit

Image-Text-to-Text • 0.1B • Updated May 13 • 22

amd/Kimi-K2.5-Eagle3-FP8

3B • Updated Jun 26 • 53 • 1

hardik-xi11/gemma-4-31B-it-DFlash

Text Generation • 2B • Updated May 14 • 9

coolthor/Huihui-gemma-4-26B-A4B-it-abliterated-eagle3-draft

0.9B • Updated Jun 2 • 23 • 2

Anbeeld/gemma-4-31B-it-DFlash-GGUF

Text Generation • 2B • Updated 16 days ago • 5.42k • 6

Lucebox/gemma-4-31B-it-DFlash-GGUF

2B • Updated May 22 • 160 • 7

Lucebox/gemma-4-26B-A4B-it-DFlash-GGUF

0.4B • Updated May 22 • 118 • 2

inferencerlabs/Qwen3.6-27B-MTP-MLX

Image-Text-to-Text • 0.4B • Updated Jun 27 • 864 • 4

inferencerlabs/Qwen3.6-27B-MTP-MLX-Q9

Image-Text-to-Text • 0.1B • Updated Jun 27 • 285 • 2

inferencerlabs/Qwen3.6-27B-MTP-MLX-Q4

Image-Text-to-Text • 66.4M • Updated Jun 27 • 321

inferencerlabs/Qwen3.6-35B-A3B-MTP-MLX

Image-Text-to-Text • 0.8B • Updated Jun 27 • 206

inferencerlabs/Qwen3.6-35B-A3B-MTP-MLX-Q9

Image-Text-to-Text • 0.3B • Updated Jun 27 • 343 • 3

inferencerlabs/Qwen3.6-35B-A3B-MTP-MLX-Q4

Image-Text-to-Text • 0.1B • Updated Jun 27 • 309 • 1

inferencerlabs/gemma-4-31B-MTP-MLX

Image-Text-to-Text • 0.5B • Updated Jun 27 • 626 • 2

inferencerlabs/gemma-4-31B-MTP-MLX-Q9

Image-Text-to-Text • 0.1B • Updated Jun 27 • 255 • 1