Vortex
					Collection
				
ModelCloud optimized and validated quants that pass/meet strict quality assurance on multiple benchmarks.  No one quantize
					• 
				24 items
				• 
				Updated
					
				•
					
					10
This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.
SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
|             Tasks             |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge                  |      1|none  |     0|acc     |↑  |0.5828|±  |0.0144|
|                               |       |none  |     0|acc_norm|↑  |0.6007|±  |0.0143|
|mmlu (stem)                    |      2|none  |      |acc     |↑  |0.6673|±  |0.0080|
| - abstract_algebra            |      1|none  |     0|acc     |↑  |0.4200|±  |0.0496|
| - anatomy                     |      1|none  |     0|acc     |↑  |0.7185|±  |0.0389|
| - astronomy                   |      1|none  |     0|acc     |↑  |0.8553|±  |0.0286|
| - college_biology             |      1|none  |     0|acc     |↑  |0.8681|±  |0.0283|
| - college_chemistry           |      1|none  |     0|acc     |↑  |0.5300|±  |0.0502|
| - college_computer_science    |      1|none  |     0|acc     |↑  |0.6300|±  |0.0485|
| - college_mathematics         |      1|none  |     0|acc     |↑  |0.4800|±  |0.0502|
| - college_physics             |      1|none  |     0|acc     |↑  |0.5686|±  |0.0493|
| - computer_security           |      1|none  |     0|acc     |↑  |0.7800|±  |0.0416|
| - conceptual_physics          |      1|none  |     0|acc     |↑  |0.7660|±  |0.0277|
| - electrical_engineering      |      1|none  |     0|acc     |↑  |0.7379|±  |0.0366|
| - elementary_mathematics      |      1|none  |     0|acc     |↑  |0.6296|±  |0.0249|
| - high_school_biology         |      1|none  |     0|acc     |↑  |0.8710|±  |0.0191|
| - high_school_chemistry       |      1|none  |     0|acc     |↑  |0.6453|±  |0.0337|
| - high_school_computer_science|      1|none  |     0|acc     |↑  |0.7800|±  |0.0416|
| - high_school_mathematics     |      1|none  |     0|acc     |↑  |0.4481|±  |0.0303|
| - high_school_physics         |      1|none  |     0|acc     |↑  |0.5166|±  |0.0408|
| - high_school_statistics      |      1|none  |     0|acc     |↑  |0.6620|±  |0.0323|
| - machine_learning            |      1|none  |     0|acc     |↑  |0.5714|±  |0.0470|
Base model
marin-community/marin-32b-base