marcelone
/

Llama-3.1-Swallow-8B-Instruct-v0.5-gguf

Model card Files Files and versions

marcelone commited on Jul 26

Commit

73a2fc2

·

verified ·

1 Parent(s): 161697a

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -9,4 +9,7 @@ base_model_relation: quantized
 ---
 # Swallow-8B-it-v05-gguf-q8_0-mixed-v1
 * **Quantization Type**: Mixed Precision (`bf16`, `q4_K`, `q5_K`, `q6_K`, `q8_0`)
-* **Bits Per Weight (BPW)**: `8.01`

 ---
 # Swallow-8B-it-v05-gguf-q8_0-mixed-v1
 * **Quantization Type**: Mixed Precision (`bf16`, `q4_K`, `q5_K`, `q6_K`, `q8_0`)
+* **Bits Per Weight (BPW)**: `8.01`
+# Swallow-8B-it-v05-gguf-q8_0-mixed-v2
+* **Quantization Type**: Mixed Precision (`bf16`, `q5_K`, `q6_K`, `q8_0`)
+* **Bits Per Weight (BPW)**: `9.31`