Update README.md
Browse files
README.md
CHANGED
|
@@ -9,8 +9,8 @@ I recommand you putting information about the persona and yourself in the system
|
|
| 9 |
|
| 10 |
I sadly have a problem with the prompt format, in the tokenizer_config.json
|
| 11 |
|
| 12 |
-
I try to recreate what DeepSeek have done with their distill : they
|
| 13 |
|
| 14 |
-
I did the same, but on my side, the first
|
| 15 |
|
| 16 |
-
Other than that, the model seem fully functionnal, feel free to try, but be sure to prefill
|
|
|
|
| 9 |
|
| 10 |
I sadly have a problem with the prompt format, in the tokenizer_config.json
|
| 11 |
|
| 12 |
+
I try to recreate what DeepSeek have done with their distill : they added `<think>` at the beginning of each assistant reply and cut off the thinking part in the context.
|
| 13 |
|
| 14 |
+
I did the same, but on my side, the first `<think>` don't appear using "Chat completion".
|
| 15 |
|
| 16 |
+
Other than that, the model seem fully functionnal, feel free to try, but be sure to prefill `<think>` one way or another.
|