MikeRoz
/

Qwen3-235B-A22B-exl2

Text Generation

Model card Files Files and versions

MikeRoz commited on May 13

Commit

d7430d6

·

verified ·

1 Parent(s): bc819c8

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -13,6 +13,7 @@ Exllamav2 quantization of [Qwen/Qwen3-235B-A22B](https://huggingface.co/Qwen/Qwe
 Quantized using commit 68976a0 of the dev branch of [exllamav2](https://github.com/turboderp-org/exllamav2). Support for this architecture does not appear to be in the main branch as of this writing. To use this model, please either build the dev branch from source, or wait for a future release.
 [3.00 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl2/tree/3.00bpw_H6) 83.410 GiB
 [4.00 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl2/tree/4.00bpw_H6) 110.628 GiB
 [measurement.json](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl2/blob/main/measurement.json)

 Quantized using commit 68976a0 of the dev branch of [exllamav2](https://github.com/turboderp-org/exllamav2). Support for this architecture does not appear to be in the main branch as of this writing. To use this model, please either build the dev branch from source, or wait for a future release.
+[2.25 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl2/tree/2.25bpw_H6) 63.580 GiB
 [3.00 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl2/tree/3.00bpw_H6) 83.410 GiB
 [4.00 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl2/tree/4.00bpw_H6) 110.628 GiB
 [measurement.json](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl2/blob/main/measurement.json)