amd/gemma-4-12B-it-w4a16-llmcompressor-v0.12.0
Text Generation • 12B • Updated • 1.23k
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
581
Active filters: llm-compressor
casperhansen/Qwen3.5-0.8B-MXFP4xMXFP8
0.9B • Updated • 29
devpramod-intel/granite-4.1-3b-quantized.w8a8
Text Generation • 4B • Updated • 1.38k
devpramod-intel/granite-4.1-8b-quantized.w8a8
Text Generation • 9B • Updated • 233
RedHatAI/Qwen3.8-2.4T-A95B-NVFP4-REAP-50
Text Generation • 1.3T • Updated • 392 • 3
casperhansen/Qwen3.6-35B-A3B-MXFP4xMXFP8
36B • Updated • 163
BarraHome/gemma-4-31B-it-assistant-FP8-block
Any-to-Any • 0.5B • Updated • 26
deluxetiky/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NVFP4
Text Generation • 27B • Updated • 334
BarraHome/gemma-4-31B-it-assistant-FP8-dynamic
Any-to-Any • 0.5B • Updated • 102
abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 34.6k • 2
abhishekchohan/Qwen3.8-27B-AWQ-INT4
Image-Text-to-Text • 28B • Updated • 215
amd/gemma-4-26B-A4B-it-w4a16-llmcompressor
Text Generation • 26B • Updated • 385
hyssra/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1-NVFP4-W4A4
Image-Text-to-Text • 27B • Updated • 45
abhishekchohan/Qwen3.8-27B-AWQ-INT4-FP8KV
Image-Text-to-Text • 28B • Updated • 1.99k
ProprietaryLegal/Thomson-1.0-Small-NVFP4
Image-Text-to-Text • 21B • Updated • 148
RishabhSinha/Qwen3.5-9B-FP8-block
Image-Text-to-Text • 9B • Updated • 17
RishabhSinha/Qwen3.5-9B-NVFP4
Image-Text-to-Text • 9B • Updated • 53
kaitchup/Ornith-1.5-9B-hum-high
10B • Updated • 40
xdavxd/gemma-4-12B-it-heretic-v2-NVFP4
Image-Text-to-Text • 12B • Updated • 150
mahadev9/Qwen3.5-0.8B-fp8
0.8B • Updated • 17
mahadev9/Qwen3.5-4B-fp8
4B • Updated • 27
Vishva007/Qwen3.8-2B-Distill-W4A16-AutoRound
Image-Text-to-Text • 1B • Updated • 101
Vishva007/Qwen3.8-2B-Distill-W4A16-AutoRound-GPTQ
Image-Text-to-Text • 2B • Updated • 79
Vishva007/Qwen3.8-2B-Distill-W4A16-AutoRound-LLM-Compressor
Image-Text-to-Text • 2B • Updated • 110
Vishva007/Qwen3.8-4B-Distill-W4A16-AutoRound
Image-Text-to-Text • 2B • Updated • 55
Vishva007/Qwen3.8-4B-Distill-W4A16-AutoRound-GPTQ
Image-Text-to-Text • 5B • Updated • 59
Vishva007/Qwen3.8-4B-Distill-W4A16-AutoRound-LLM-Compressor
Image-Text-to-Text • 5B • Updated • 92
Vishva007/NuExtract3-W4A16-AutoRound
Image-Text-to-Text • 2B • Updated • 74
Vishva007/NuExtract3-W4A16-AutoRound-GPTQ
Image-Text-to-Text • 5B • Updated • 51
Vishva007/NuExtract3-W4A16-AutoRound-LLM-Compressor
Image-Text-to-Text • 5B • Updated • 65