This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.

SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024โ€“2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
| Metric                         |   Eval   |
|--------------------------------|----------|
| arc_challenge :: acc,none      |   0.3968 |
| arc_challenge :: acc_norm,none |   0.4138 |
| mmlu_stem :: acc,none          |   0.4015 |
Downloads last month
38
Safetensors
Model size
1B params
Tensor type
BF16
ยท
I32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ModelCloud/Granite-4.0-H-1B-GPTQMODEL-W4A16

Quantized
(19)
this model