Commit
·
5bdaebe
1
Parent(s):
2bd5f8d
Update README.md
Browse files
README.md
CHANGED
|
@@ -38,7 +38,24 @@ korean multi-task instruction dataset
|
|
| 38 |
- PEFT 0.4.0
|
| 39 |
|
| 40 |
## Training
|
| 41 |
-
Refer github
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
|
| 43 |
------------------------------------------------
|
| 44 |
# Original model card: Meta's Llama 2 13B-chat
|
|
|
|
| 38 |
- PEFT 0.4.0
|
| 39 |
|
| 40 |
## Training
|
| 41 |
+
Refer https://github.com/davidkim205/komt
|
| 42 |
+
|
| 43 |
+
## Evaluation
|
| 44 |
+
|
| 45 |
+
| model | score | average(0~5) | percentage |
|
| 46 |
+
| --------------------------------------- | ------- | ------------ | ---------- |
|
| 47 |
+
| gpt-3.5-turbo(close) | 147 | 3.97 | 79.45% |
|
| 48 |
+
| naver Cue(close) | 140 | 3.78 | 75.67% |
|
| 49 |
+
| clova X(close) | 136 | 3.67 | 73.51% |
|
| 50 |
+
| WizardLM-13B-V1.2(open) | 96 | 2.59 | 51.89% |
|
| 51 |
+
| Llama-2-7b-chat-hf(open) | 67 | 1.81 | 36.21% |
|
| 52 |
+
| Llama-2-13b-chat-hf(open) | 73 | 1.91 | 38.37% |
|
| 53 |
+
| nlpai-lab/kullm-polyglot-12.8b-v2(open) | 70 | 1.89 | 37.83% |
|
| 54 |
+
| kfkas/Llama-2-ko-7b-Chat(open) | 96 | 2.59 | 51.89% |
|
| 55 |
+
| beomi/KoAlpaca-Polyglot-12.8B(open) | 100 | 2.70 | 54.05% |
|
| 56 |
+
| **komt-llama2-7b-v1 (open)(ours)** | **117** | **3.16** | **63.24%** |
|
| 57 |
+
| **komt-llama2-13b-v1 (open)(ours)** | **129** | **3.48** | **69.72%** |
|
| 58 |
+
|
| 59 |
|
| 60 |
------------------------------------------------
|
| 61 |
# Original model card: Meta's Llama 2 13B-chat
|