Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,18 @@ tags:
|
|
| 8 |
library_name: adapter-transformers
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# Alpaca Native Enhanced 7B model download for Alpaca.cpp, Llama.cpp, and Dalai
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
library_name: adapter-transformers
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Alpaca Native Enhanced 7B model download for Alpaca.cpp, Llama.cpp, and Dalai
|
| 12 |
+
|
| 13 |
+
Use this command to run with llama.cpp
|
| 14 |
+
```sh
|
| 15 |
+
main -m models/ANE-7B/ggml-model-q4_1.bin -n -1 --ctx_size 2048 --batch_size 16 --keep 512 --repeat_penalty 1.0 -t 16 --temp 0.4 --top_k 30 --top_p 0.18 --interactive-first -ins --color -i -r "User:" -f prompts/alpacanativeenhanced.txt
|
| 16 |
+
```
|
| 17 |
+
|
| 18 |
+
contents of `prompts/alpacanativeenhanced.txt` should be
|
| 19 |
+
```txt
|
| 20 |
+
You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history.
|
| 21 |
+
|
| 22 |
+
User: Hey, how's it going?
|
| 23 |
+
|
| 24 |
+
Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!
|
| 25 |
+
```
|