Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,758

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 24 days ago • 839k • • 1.19k

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated 25 days ago • 2.71M • 758

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 59.7k • 151

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 13.4k • 122

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated Jun 27 • 31.4k • 63

Hikari07jp/Maple-Preview-TQ2-Abliterated

Text Generation • 20B • Updated 4 days ago • 478 • 4

NANI-Nithin/Muse-Glimmer-30B-GGUF

Image-Text-to-Text • 28B • Updated 1 day ago • 4

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 152k • 135

livadies/Bonsai-27B-Android-Local

Text Generation • 27B • Updated 27 days ago • 1.91k • 4

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 1.06k • 276

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 7.94k • 326

hellork/Qwen3.6-12B-IQ-Ultra-Heretic-Uncensored-Thinking-V2-Hightop-Q4_K_M-GGUF

Image-Text-to-Text • 12B • Updated May 21 • 770 • 2

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 10.3k • 21

Ruler97/Godoter-27B-GGUF

Text Generation • 27B • Updated Jun 17 • 1.81k • 5

Prototype3550/Qwen3.6-9B-Heretic-Uncensored-Thinking-Sweet-Madness-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Jun 18 • 7.7k • 5

vcruz305/Ornith-1.0-35B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 35B • Updated Jul 3 • 43.8k • 16

fisher046/snowflake-arctic-embed-l-v2.0-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Jul 2 • 88 • 2

Furude0Rika/Gemma-4-26B-A4B-it-Uncensored-Apex-Quality

25B • Updated Jul 3 • 272 • 2

Azraell/qwen2.5-coder-7b-magicoder-lora-Q8_0-GGUF

40.4M • Updated Jul 6 • 27 • 2

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated 29 days ago • 16k • 20

i7l/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-Q3_K_M-GGUF

Text Generation • 1B • Updated 21 days ago • 208 • 2

deadbydawn101/gemma-4-E4B-Agentic-Sol-Fable-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated 18 days ago • 2.67k • 4

WhiskyAKM/Ling-3.0-flash-GGUF

Text Generation • 127B • Updated 5 days ago • 163 • 2

shafire/OpenZero-Gemma4-E2B-Agentic-GGUF

Text Generation • 5B • Updated 1 day ago • 2

hus960/Llama-3-13B-Instruct-Q4_K_M-GGUF

13B • Updated Apr 27, 2024 • 75 • 1

v8karlo/UNCENSORED-Phi-3-mini-4k-geminified-Q4_K_M-GGUF

Text Generation • 4B • Updated Jun 6, 2024 • 679 • 10

NikolayKozloff/llama-3-llamilitary-Q8_0-GGUF

8B • Updated Jul 4, 2024 • 17 • 4

notjjustnumbers/madlad400-3b-mt-Q4_K_M-GGUF

Translation • 3B • Updated Jul 8, 2024 • 1.85k • 5

SkyNotion/deepseek-coder-7b-instruct-v1.5-Q4_K_M-GGUF

7B • Updated Jul 30, 2024 • 473 • 2

hellork/Phi-3-mini-4k-geminified-IQ4_NL-GGUF

Text Generation • 4B • Updated Sep 17, 2024 • 91 • 1