Update README.md

README.md

@@ -11,6 +11,19 @@ pipeline_tag: text-generation
 tags:
 - not-for-all-audiences
 ---
+## Exl2 version of [maywell/PiVoT-0.1-Evil-a](https://huggingface.co/maywell/PiVoT-0.1-Evil-a)  
+
+## branch  
+main : 8bpw h8  
+6bh8 : 6bpw h8  
+4bh8 : 4bpw h8  
+
+Using [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer) as dataset  
+ 
+Quantization settings : ```python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp -cf PiVoT-0.1-Evil-a-8bpw-h8-exl2 -c 0000.parquet -l 4096 -b 8 -hb 8```  
+```python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp2 -cf PiVoT-0.1-Evil-a-6bpw-h8-exl2 -c 0000.parquet -l 4096 -b 6 -hb 8 -m PiVoT-0.1-Evil-a-temp/measurement.json```  
+```python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp3 -cf PiVoT-0.1-Evil-a-4bpw-h8-exl2 -c 0000.parquet -l 4096 -b 4 -hb 8 -m PiVoT-0.1-Evil-a-temp/measurement.json```  
+### below this line is original readme  
 
 # PiVoT-0.1-early