Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

79

Base only

Active filters: w4a4

sakamakismile/Huihui-ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated 15 days ago • 8.02k • 33

ariaotp/INT4-ConvRot-W4A4-ComfyUI

Updated 6 days ago • 26

sakamakismile/Huihui-gemma-4-26B-A4B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 16B • Updated Jun 12 • 736 • 2

sakamakismile/Qwen3.6-27B-MTP-pi-tune-NVFP4

Image-Text-to-Text • 17B • Updated Jun 17 • 66k • 11

sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated 20 days ago • 5.93k • 20

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated 6 days ago • 50 • 1

sakamakismile/Solar-Open2-250B-NVFP4A16

142B • Updated 3 days ago • 50 • 1

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4

Text Generation • 8B • Updated Sep 3, 2024 • 6 • 1

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29 • 34

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 7

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated Feb 22 • 169

JongYeop/Qwen2.5-VL-7B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Feb 22 • 8

JongYeop/Qwen2.5-VL-3B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 2B • Updated Mar 5 • 4

JongYeop/Qwen2.5-VL-7B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Mar 5 • 5

nivvis/Qwen3.5-35B-A3B-heretic-v2-NVFP4

Image-Text-to-Text • Updated Mar 18 • 9

dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B-NVFP4-GB10

Text Generation • 79B • Updated Apr 17 • 1.17k • 4

Ex0bit/Qwen3.6-35B-A3B-PRISM-NVFP4

Text Generation • Updated May 3 • 41.3k • 20

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • 21B • Updated Jun 8 • 498 • 2

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 89 • 1

BitsPlease/HiSQRot4

Text-to-Video • Updated May 8

nerkyor/Lynn-V4-Pro-Distill-Qwen-35B-A3B-NVFP4-v8-RTN

Text Generation • 20B • Updated May 14 • 23

ultranationalism/nunchaku-z-image-turbo-svdq

Text-to-Image • 4B • Updated May 24 • 1

pyloxsystems/hochelaga-8b-nvfp4

Text Generation • 5B • Updated Jun 24 • 14

dangvansam/chandra-ocr-2-NVFP4

Image-Text-to-Text • 3B • Updated May 26 • 2.35k

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-mse

21B • Updated May 31 • 7

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse-preview

21B • Updated May 31 • 7

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-mse-preview

20B • Updated May 31 • 8

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse

21B • Updated May 31 • 5

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-awqclip

20B • Updated May 31 • 18.8k

coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-W4A4

Image-Text-to-Text • 21B • Updated Jun 2 • 292