Hugging Face's logo

T145
/
ZEUS-8B-V17

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
Eval Results
text-generation-inference
Model card Files
xet
Community
1
T145 commited on
Commit
c7537fd
·
verified ·
1 Parent(s): 05afbe3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -26,7 +26,8 @@ model-index:
26
  value: 79.41
27
  name: averaged accuracy
28
  source:
29
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
 
30
  name: Open LLM Leaderboard
31
  - task:
32
  type: text-generation
@@ -42,7 +43,8 @@ model-index:
42
  value: 32.34
43
  name: normalized accuracy
44
  source:
45
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
 
46
  name: Open LLM Leaderboard
47
  - task:
48
  type: text-generation
@@ -58,7 +60,8 @@ model-index:
58
  value: 21.15
59
  name: exact match
60
  source:
61
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
 
62
  name: Open LLM Leaderboard
63
  - task:
64
  type: text-generation
@@ -74,7 +77,8 @@ model-index:
74
  value: 9.62
75
  name: acc_norm
76
  source:
77
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
 
78
  name: Open LLM Leaderboard
79
  - task:
80
  type: text-generation
@@ -89,7 +93,8 @@ model-index:
89
  value: 9.64
90
  name: acc_norm
91
  source:
92
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
 
93
  name: Open LLM Leaderboard
94
  - task:
95
  type: text-generation
@@ -106,8 +111,10 @@ model-index:
106
  value: 32.61
107
  name: accuracy
108
  source:
109
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
 
110
  name: Open LLM Leaderboard
 
111
  ---
112
  # ZEUS 8B 🌩️ V17
113
 
@@ -177,5 +184,4 @@ Summarized results can be found [here](https://huggingface.co/datasets/open-llm-
177
  |MATH Lvl 5 (4-Shot)| 21.15|
178
  |GPQA (0-shot) | 9.62|
179
  |MuSR (0-shot) | 9.64|
180
- |MMLU-PRO (5-shot) | 32.61|
181
-
 
26
  value: 79.41
27
  name: averaged accuracy
28
  source:
29
+ url: >-
30
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
31
  name: Open LLM Leaderboard
32
  - task:
33
  type: text-generation
 
43
  value: 32.34
44
  name: normalized accuracy
45
  source:
46
+ url: >-
47
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
48
  name: Open LLM Leaderboard
49
  - task:
50
  type: text-generation
 
60
  value: 21.15
61
  name: exact match
62
  source:
63
+ url: >-
64
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
65
  name: Open LLM Leaderboard
66
  - task:
67
  type: text-generation
 
77
  value: 9.62
78
  name: acc_norm
79
  source:
80
+ url: >-
81
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
82
  name: Open LLM Leaderboard
83
  - task:
84
  type: text-generation
 
93
  value: 9.64
94
  name: acc_norm
95
  source:
96
+ url: >-
97
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
98
  name: Open LLM Leaderboard
99
  - task:
100
  type: text-generation
 
111
  value: 32.61
112
  name: accuracy
113
  source:
114
+ url: >-
115
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=T145%2FZEUS-8B-V17
116
  name: Open LLM Leaderboard
117
+ new_version: T145/ZEUS-8B-V22
118
  ---
119
  # ZEUS 8B 🌩️ V17
120
 
 
184
  |MATH Lvl 5 (4-Shot)| 21.15|
185
  |GPQA (0-shot) | 9.62|
186
  |MuSR (0-shot) | 9.64|
187
+ |MMLU-PRO (5-shot) | 32.61|