ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v2

This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.

SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).

ARC_Challenge and MMLU evals pending.

Downloads last month: 137

Safetensors

Model size

357B params

Tensor type

BF16

F16

I32

F32

Model tree for ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v2

Base model

zai-org/GLM-4.6

Quantized

(32)

this model

Collection including ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v2

Vortex

Collection

ModelCloud optimized and validated quants that pass/meet strict quality assurance on multiple benchmarks. No one quantize • 23 items • Updated about 5 hours ago • 10