Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
eaddario
/
Mistral-Small-3.2-24B-Instruct-2506-pruned-GGUF
like
0
Text Generation
GGUF
eaddario/imatrix-calibration
English
quant
pruned
experimental
arxiv:
2406.17415
arxiv:
2403.03853
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Mistral-Small-3.2-24B-Instruct-2506-pruned-GGUF
240 GB
1 contributor
History:
22 commits
eaddario
Update README.md
c8c534c
verified
4 months ago
imatrix
Generate imatrices
4 months ago
logits
Generate base model logits
4 months ago
scores
Add GGUF internal file structure
4 months ago
.gitattributes
Safe
1.6 kB
Update .gitattributes
4 months ago
.gitignore
Safe
6.78 kB
Add .gitignore
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-F16.gguf
Safe
44.9 GB
xet
Convert & prune safetensor to GGUF @ F16
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-IQ3_M.gguf
Safe
10.3 GB
xet
Pruned & layer-wise quantization IQ3_M
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-IQ3_S.gguf
Safe
9.57 GB
xet
Pruned & layer-wise quantization IQ3_S
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-IQ4_NL.gguf
Safe
12.5 GB
xet
Pruned & layer-wise quantization IQ4_NL
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q3_K_L.gguf
Safe
10.9 GB
xet
Pruned & layer-wise quantization Q3_K_L
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q3_K_M.gguf
Safe
9.97 GB
xet
Pruned & layer-wise quantization Q3_K_M
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q3_K_S.gguf
Safe
9.01 GB
xet
Pruned & layer-wise quantization Q3_K_S
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q4_K_M.gguf
Safe
12.5 GB
xet
Pruned & layer-wise quantization Q4_K_M
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q4_K_S.gguf
11.6 GB
xet
Pruned & layer-wise quantization Q4_K_S
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q5_K_M.gguf
Safe
15.3 GB
xet
Pruned & layer-wise quantization Q5_K_M
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q5_K_S.gguf
Safe
14.5 GB
xet
Pruned & layer-wise quantization Q5_K_S
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q6_K.gguf
Safe
18.9 GB
xet
Pruned & layer-wise quantization Q6_K
4 months ago
Mistral-Small-3.2-24B-Instruct-2506-pruned-Q8_0.gguf
Safe
20.3 GB
xet
Pruned & layer-wise quantization Q8_0
4 months ago
README.md
Safe
24.9 kB
Update README.md
4 months ago
