This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.

SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
|             Tasks             |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge                  |      1|none  |     0|acc     |↑  |0.5828|±  |0.0144|
|                               |       |none  |     0|acc_norm|↑  |0.6007|±  |0.0143|
|mmlu (stem)                    |      2|none  |      |acc     |↑  |0.6673|±  |0.0080|
| - abstract_algebra            |      1|none  |     0|acc     |↑  |0.4200|±  |0.0496|
| - anatomy                     |      1|none  |     0|acc     |↑  |0.7185|±  |0.0389|
| - astronomy                   |      1|none  |     0|acc     |↑  |0.8553|±  |0.0286|
| - college_biology             |      1|none  |     0|acc     |↑  |0.8681|±  |0.0283|
| - college_chemistry           |      1|none  |     0|acc     |↑  |0.5300|±  |0.0502|
| - college_computer_science    |      1|none  |     0|acc     |↑  |0.6300|±  |0.0485|
| - college_mathematics         |      1|none  |     0|acc     |↑  |0.4800|±  |0.0502|
| - college_physics             |      1|none  |     0|acc     |↑  |0.5686|±  |0.0493|
| - computer_security           |      1|none  |     0|acc     |↑  |0.7800|±  |0.0416|
| - conceptual_physics          |      1|none  |     0|acc     |↑  |0.7660|±  |0.0277|
| - electrical_engineering      |      1|none  |     0|acc     |↑  |0.7379|±  |0.0366|
| - elementary_mathematics      |      1|none  |     0|acc     |↑  |0.6296|±  |0.0249|
| - high_school_biology         |      1|none  |     0|acc     |↑  |0.8710|±  |0.0191|
| - high_school_chemistry       |      1|none  |     0|acc     |↑  |0.6453|±  |0.0337|
| - high_school_computer_science|      1|none  |     0|acc     |↑  |0.7800|±  |0.0416|
| - high_school_mathematics     |      1|none  |     0|acc     |↑  |0.4481|±  |0.0303|
| - high_school_physics         |      1|none  |     0|acc     |↑  |0.5166|±  |0.0408|
| - high_school_statistics      |      1|none  |     0|acc     |↑  |0.6620|±  |0.0323|
| - machine_learning            |      1|none  |     0|acc     |↑  |0.5714|±  |0.0470|
Downloads last month
26
Safetensors
Model size
33B params
Tensor type
BF16
·
I32
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ModelCloud/Marin-32B-Base-GPTQMODEL-AWQ-W4A16

Quantized
(4)
this model

Collection including ModelCloud/Marin-32B-Base-GPTQMODEL-AWQ-W4A16