Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

138

Base only

Active filters: text-only

RhinoWithAcape/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUF

Text Generation • 32B • Updated Apr 28 • 28

Darkhn/Mistral-Medium-3.5-128B-BF16-Text-Only

125B • Updated May 2 • 814 • 3

darkc0de/XORTRON.CriminalComputing.Config.LARGE.XPRT2

Text Generation • 125B • Updated May 1 • 101 • 5

loay/gemma-4-E4B-it-abliterated-en-ar-text-only

Text Generation • 6B • Updated May 2 • 13

jngb-labs/gemma4-E2B-text-3bit

Text Generation • 3B • Updated May 28 • 6

NeuR0mancR/Neural-v1-24B

Text Generation • 24B • Updated May 6 • 13 • 3

ltpla/gemma-4-e4b-it-noaudio-8bit

Any-to-Any • 2B • Updated May 7 • 11

ltpla/gemma-4-e4b-it-noaudio-4bit

Any-to-Any • 1B • Updated May 7 • 12

mradermacher/XORTRON.CriminalComputing.Config.LARGE.XPRT2-GGUF

125B • Updated May 8 • 82

NeuR0mancR/Neural-v1-24B-GGUF

24B • Updated May 7 • 395

mradermacher/XORTRON.CriminalComputing.Config.LARGE.XPRT2-i1-GGUF

125B • Updated May 9 • 462

litcloud/Qwen3.6-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated May 10 • 148 • 1

igorls/gemma4-e4b-classifier

Text Generation • 7B • Updated May 12 • 96

nilayparikh/Qwen3.6-27B-Text-NVFP4-MTP-GGUF

Text Generation • 27B • Updated May 30 • 58 • 10

cookietimeh/XORTRON.CriminalComputing.Config.LARGE.XPRT2-mlx-4Bit

Text Generation • 125B • Updated May 19 • 86

bowmanslayer/Qwen3.6-27B-Text-Only-W4A16-g128-ToolCalling

Text Generation • Updated May 22 • 1

bowmanslayer/Qwen3.6-27B-Text-Only-W4A16-g128-MTP-ToolCalling

Text Generation • Updated May 22 • 1

cascade-tech/Ministral-3-3B-Instruct-2512-BF16-llama-text

Text Generation • 3B • Updated May 26 • 21

cascade-tech/Ministral-3-3B-Instruct-2512-FP8-llama-text

Text Generation • 3B • Updated May 26 • 21

spinochenza/XORTRON.CriminalComputing.Config.LARGE.XPRT2

Text Generation • 125B • Updated May 29 • 9 • 1

divinetribe/gemma-4-12B-it-abliterated-4bit-mlx-text

Text Generation • 3B • Updated 3 days ago • 162

rajaschitnis/gemma-4-12b-it-text-only-4bit-mlx

Text Generation • 3B • Updated Jun 5 • 117 • 1

mindqtrl/qwen3vl-8b-fp8-text-only-en

Text Generation • 8B • Updated Jun 13 • 6

Noctalin/Qwen3.6-27B-oQ8-fp16-mtp

Text Generation • 8B • Updated Jun 17 • 226 • 3

Noctalin/Qwen3.6-35B-A3B-oQ8-fp16-mtp

Text Generation • 10B • Updated Jun 17 • 156 • 1

phatvucoder/gemma-4-E4B-it-qat-q4_0-unquantized-text-only

Text Generation • 8B • Updated Jun 10 • 8

phatvucoder/gemma-4-E4B-it-qat-text-only-Q4_K_M-GGUF

Text Generation • 7B • Updated Jun 10 • 113

UnstableLlama/Mistral-Medium-3.5-128B-desiccated-LoRA

Updated Jun 15 • 1

UnstableLlama/Mistral-Medium-3.5-128B-desiccated

125B • Updated Jun 15 • 16

UnstableLlama/Mistral-Medium-3.5-128B-desiccated-exl3-2.50bpw

21B • Updated Jun 15 • 14