OPEA
/

Llama-3.3-70B-Instruct-int4-sym-inc

4-bit precision

Model card Files Files and versions

cicdatopea commited on Dec 12, 2024

Commit

4329b3d

·

verified ·

1 Parent(s): 44f1cc3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -119,7 +119,7 @@ pip3 install lm-eval==0.4.5
 ## Generate the model
-Here is the sample command to reproduce the model.  We found auto-round is not stable for this model, please do NOT use  --model_dtype "fp16"
 ```bash
 auto-round  \

 ## Generate the model
+Here is the sample command to reproduce the model.
 ```bash
 auto-round  \