starsy
/

Llama-3-70B-Instruct-Gradient-1048k-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

starsy commited on May 17, 2024

Commit

5f4c1ed

·

verified ·

1 Parent(s): 3304dee

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ license: llama3
 ---
 # Introduction
-**This is a 4-bit [AWQ](https://github.com/casper-hansen/AutoAWQ) quantized model of [gradientai/Llama-3-70B-Instruct-Gradient-1048k](https://huggingface.co/gradientai/Llama-3-70B-Instruct-Gradient-1048k).**
 ---

 ---
 # Introduction
+**This is a 4-bit [AWQ(GEMM)](https://github.com/casper-hansen/AutoAWQ) quantized model of [gradientai/Llama-3-70B-Instruct-Gradient-1048k](https://huggingface.co/gradientai/Llama-3-70B-Instruct-Gradient-1048k).**
 ---