Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

504

Base only

Active filters: fp4

SergiusFlavius/Qwen3-VL-4B-Instruct-heretic-NVFP4

Image-Text-to-Text • Updated Jul 1 • 12

nvidia/Qwen3.5-397B-A17B-NVFP4-V2

Text Generation • Updated Jun 30 • 15.2k • 11

maci0/Qwopus3.6-27B-Coder-NVFP4

Image-Text-to-Text • 27B • Updated 3 days ago • 572k • 3

maci0/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-NVFP4

Image-Text-to-Text • 9B • Updated 3 days ago • 856 • 4

williamliao/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated 24 days ago • 3.31k • 17

maci0/Ornith-1.0-35B-abliterated-NVFP4

Image-Text-to-Text • 35B • Updated 3 days ago • 578 • 1

Blackfrost-AI/GLM-5.2-ABLITERATED-NVFP4

Text Generation • 386B • Updated 7 days ago • 3.67k • 7

UrocyonF/Qwen3-ASR-1.7B-NVFP4

Automatic Speech Recognition • 2B • Updated 14 days ago • 42 • 1

tengsnake/Llama-Guard-4-12B-NVFP4

Text Generation • 12B • Updated 9 days ago • 70 • 3

Arsh9210/GLM-5.2-NVFP4

Text Generation • 381B • Updated 7 days ago • 16 • 1

RMDWLLC/Jah-3.0

Text Generation • 304B • Updated 6 days ago • 45 • 1

AGIcafet/openthaigpt-1.6-72b-instruct-NVFP4

73B • Updated 1 day ago • 79 • 1

rockerBOO/Qwen3-VL-32B-Instruct-NVFP4

Text Generation • Updated 4 days ago • 1

shadowrock-io/Nemotron-3-Embed-8B-Community-NVFP4

Sentence Similarity • 5B • Updated 3 days ago • 11 • 1

nmitchko/DeepSeek-V4-Flash-0731-Latent-Reasoning

Text Generation • 304B • Updated about 7 hours ago • 130 • 1

ironbcc/Qwen3-Embedding-4B-NVFP4A16

Feature Extraction • 4B • Updated about 13 hours ago • 1

mengqin1/RedidreamNSFWI1-bnb-4bit

Updated May 10, 2025 • 1

qingcheng-ai/QwQ-32B-fp4

Text Generation • 19B • Updated Jun 24, 2025 • 7 • 3

qingcheng-ai/Qwen3-32B-fp4

Text Generation • 19B • Updated May 19, 2025 • 166 • 4

qingcheng-ai/Qwen3-8B-fp4

Text Generation • 5B • Updated May 19, 2025 • 80 • 2

RedHatAI/Llama-3.1-70B-Instruct-NVFP4

Text Generation • 41B • Updated Nov 21, 2025 • 1.95k • 1

RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16

Text Generation • 41B • Updated Jun 30, 2025 • 34

RedHatAI/Qwen3-32B-NVFP4

Text Generation • 19B • Updated Nov 21, 2025 • 2.35k • 9

RedHatAI/Qwen3-32B-NVFP4A16

Text Generation • 19B • Updated Jun 30, 2025 • 240 • 2

nvidia/Qwen3-235B-A22B-NVFP4

Text Generation • 133B • Updated Jul 8, 2025 • 173k • 19

nvidia/Qwen3-30B-A3B-NVFP4

Text Generation • 16B • Updated Sep 10, 2025 • 65.3k • 37

apolloparty/Qwen3-4B-NVFP4A16

2B • Updated Jul 12, 2025 • 7

Tonic/petite-elle-L-aime-3-sft

Text Generation • 3B • Updated Aug 2, 2025 • 18 • 1

mradermacher/petite-elle-L-aime-3-sft-GGUF

Text Generation • 3B • Updated Jul 29, 2025 • 139 • 1

nm-testing/DeepSeek-R1-Distill-Qwen-32B-NVFP4

Text Generation • 19B • Updated Nov 21, 2025 • 677 • 3