Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
gguf-org
/
quant-type
like
0
Follow
gguf
23
GGUF
License:
mit
Model card
Files
Files and versions
xet
Community
main
quant-type
6.54 MB
2 contributors
History:
25 commits
chatpig
Upload 2 files
19711c4
verified
about 2 months ago
.gitattributes
Safe
3.01 kB
Upload 2 files
about 2 months ago
README.md
Safe
88 Bytes
Update README.md
4 months ago
i-quant-iq1_m.gguf
115 kB
xet
Upload 5 files
3 months ago
i-quant-iq1_s.gguf
103 kB
xet
Upload 5 files
3 months ago
i-quant-iq2_m.gguf
168 kB
xet
Upload 2 files
about 2 months ago
i-quant-iq2_s.gguf
168 kB
xet
Upload i-quant-iq2_s.gguf
3 months ago
i-quant-iq2_xs.gguf
152 kB
xet
Upload 5 files
3 months ago
i-quant-iq2_xxs.gguf
135 kB
xet
Upload 5 files
3 months ago
i-quant-iq3_m.gguf
254 kB
xet
Upload 2 files
about 2 months ago
i-quant-iq3_s.gguf
254 kB
xet
Upload i-quant-iq3_s.gguf with huggingface_hub
4 months ago
i-quant-iq3_xxs.gguf
226 kB
xet
Upload i-quant-iq3_xxs.gguf with huggingface_hub
4 months ago
i-quant-iq4_nl.gguf
332 kB
xet
Upload i-quant-iq4_nl.gguf with huggingface_hub
4 months ago
i-quant-iq4_xs.gguf
314 kB
xet
Upload i-quant-iq4_xs.gguf with huggingface_hub
4 months ago
k-quant-q2_k.gguf
194 kB
xet
Upload k-quant-q2_k.gguf with huggingface_hub
4 months ago
k-quant-q2_k_s.gguf
194 kB
xet
Upload k-quant-q2_k_s.gguf
3 months ago
k-quant-q3_k_m.gguf
254 kB
xet
Rename k-quant-q3_k.gguf to k-quant-q3_k_m.gguf
4 months ago
k-quant-q4_k_m.gguf
Safe
332 kB
xet
Rename k-quant-q4_k.gguf to k-quant-q4_k_m.gguf
4 months ago
k-quant-q5_k_m.gguf
406 kB
xet
Rename k-quant-q5_k.gguf to k-quant-q5_k_m.gguf
4 months ago
k-quant-q6_k.gguf
484 kB
xet
Upload k-quant-q6_k.gguf with huggingface_hub
4 months ago
s-quant-q4_0.gguf
332 kB
xet
Upload s-quant-q4_0.gguf with huggingface_hub
4 months ago
s-quant-q4_1.gguf
369 kB
xet
Upload s-quant-q4_1.gguf with huggingface_hub
4 months ago
s-quant-q5_0.gguf
406 kB
xet
Upload s-quant-q5_0.gguf with huggingface_hub
4 months ago
s-quant-q5_1.gguf
443 kB
xet
Upload s-quant-q5_1.gguf with huggingface_hub
4 months ago
s-quant-q8_0.gguf
627 kB
xet
Upload s-quant-q8_0.gguf with huggingface_hub
4 months ago
t-quant-tq1_0.gguf
125 kB
xet
Upload 2 files
4 months ago
t-quant-tq2_0.gguf
152 kB
xet
Upload 2 files
4 months ago