Update README.md
Browse files
README.md
CHANGED
|
@@ -7,9 +7,7 @@ datasets:
|
|
| 7 |
OpenAssistant-Llama-13B-4-bit working with GPTQ versions used in Oobabooga's Text Generation Webui and KoboldAI.
|
| 8 |
<br>This was made using <a href="https://huggingface.co/serpdotai/llama-oasst-lora-13B">Serpdotai's Open Assistant 13b LoRa trained for 4 epochs</a> using Open Assistant's dataset.</p>
|
| 9 |
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
|
| 14 |
<p><strong><font size="5">Benchmarks</font></strong></p>
|
| 15 |
|
|
|
|
| 7 |
OpenAssistant-Llama-13B-4-bit working with GPTQ versions used in Oobabooga's Text Generation Webui and KoboldAI.
|
| 8 |
<br>This was made using <a href="https://huggingface.co/serpdotai/llama-oasst-lora-13B">Serpdotai's Open Assistant 13b LoRa trained for 4 epochs</a> using Open Assistant's dataset.</p>
|
| 9 |
|
| 10 |
+
python llama.py /KoboldAI/repos/gptq/llama13b-oasst-4-epochs-lora c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors llama13b-oasst-4-epochs-lora-4bit-128g.safetensors
|
|
|
|
|
|
|
| 11 |
|
| 12 |
<p><strong><font size="5">Benchmarks</font></strong></p>
|
| 13 |
|