251 GB

1 contributor

History: 36 commits

eaddario

Layer-wise quantization IQ3_S

d63a1bd verified 6 months ago

imatrix
Generate Small imatrix 9 months ago
logits
Regenerate base model logits 6 months ago
scores
Generate perplexity and kld scores 9 months ago
.gitattributes

1.65 kB

Update .gitattributes 9 months ago
.gitignore

6.78 kB

Update .gitignore 9 months ago
Dolphin3.0-R1-Mistral-24B-F16.gguf

47.2 GB
xet

Convert to GGUF @ F16 9 months ago
Dolphin3.0-R1-Mistral-24B-IQ3_M.gguf

10.8 GB
xet

Layer-wise quantization IQ3_M 6 months ago
Dolphin3.0-R1-Mistral-24B-IQ3_S.gguf

10.2 GB
xet

Layer-wise quantization IQ3_S 6 months ago
Dolphin3.0-R1-Mistral-24B-IQ4_NL.gguf

13.1 GB
xet

Layer-wise quantization IQ4_NL 6 months ago
Dolphin3.0-R1-Mistral-24B-Q3_K_L.gguf

11 GB
xet

Layer-wise quantization Q3_K_L 6 months ago
Dolphin3.0-R1-Mistral-24B-Q3_K_M.gguf

10.4 GB
xet

Layer-wise quantization Q3_K_M 6 months ago
Dolphin3.0-R1-Mistral-24B-Q3_K_S.gguf

9.78 GB
xet

Layer-wise quantization Q3_K_S 6 months ago
Dolphin3.0-R1-Mistral-24B-Q4_K_M.gguf

13.1 GB
xet

Layer-wise quantization Q4_K_M 6 months ago
Dolphin3.0-R1-Mistral-24B-Q4_K_S.gguf

12.6 GB
xet

Layer-wise quantization Q4_K_S 6 months ago
Dolphin3.0-R1-Mistral-24B-Q5_K_M.gguf

15.6 GB
xet

Layer-wise quantization Q5_K_M 6 months ago
Dolphin3.0-R1-Mistral-24B-Q5_K_S.gguf

14.9 GB
xet

Layer-wise quantization Q5_K_S 6 months ago
Dolphin3.0-R1-Mistral-24B-Q6_K.gguf

19.3 GB
xet

Layer-wise quantization Q6_K 6 months ago
Dolphin3.0-R1-Mistral-24B-Q8_0.gguf

23 GB
xet

Layer-wise quantization Q8_0 6 months ago
README.md

10.9 kB

Update README.md 9 months ago