ISTA-DASLab
/

Meta-Llama-3-8B-AQLM-PV-1Bit-1x16

Text Generation

text-generation-inference

Model card Files Files and versions

justheuristic commited on May 31, 2024

Commit

cc0bcb6

·

verified ·

1 Parent(s): b414226

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -22,8 +22,8 @@ Note that a large portion of this model are the 16-bit embeddings/logits matrice
 | Model      | AQLM scheme | WikiText 2 PPL | Model size, Gb | Hub link                                                                 |
 |------------|-------------|----------------|----------------|--------------------------------------------------------------------------|
-| meta-llama/Meta-Llama-3-8B  | 1x16g8        | 9.43          |  4.1           | [Link](https://huggingface.co/ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-2Bit-1x16) |
-| meta-llama/Meta-Llama-3-8B (this)  | 1x16g16        | 6.99          | 3.9            | [Link](https://huggingface.co/ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-1Bit-1x16) |
 | meta-llama/Meta-Llama-3-70B | 1x16g8        | 4.57           | 21.9           | [Link](https://huggingface.co/ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-2Bit-1x16)|

 | Model      | AQLM scheme | WikiText 2 PPL | Model size, Gb | Hub link                                                                 |
 |------------|-------------|----------------|----------------|--------------------------------------------------------------------------|
+| meta-llama/Meta-Llama-3-8B  | 1x16g8        |  6.99         |  4.1           | [Link](https://huggingface.co/ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-2Bit-1x16) |
+| meta-llama/Meta-Llama-3-8B (this)  | 1x16g16        | 9.43          | 3.9            | [Link](https://huggingface.co/ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-1Bit-1x16) |
 | meta-llama/Meta-Llama-3-70B | 1x16g8        | 4.57           | 21.9           | [Link](https://huggingface.co/ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-2Bit-1x16)|