Hugging Face's logo

uukuguy
/
speechless-code-mistral-orca-7b-v1.0

Text Generation
Transformers
PyTorch
English
mistral
llama-2
code
conversational
Eval Results
text-generation-inference
Model card Files
xet
Community
2
uukuguy commited on
Commit
8e1ba0d
·
1 Parent(s): f7db67f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -24,7 +24,7 @@ model-index:
24
  metrics:
25
  - name: pass@1
26
  type: pass@1
27
- value: 0.0
28
  verified: false
29
  ---
30
 
@@ -44,7 +44,7 @@ Total 201,981 samples.
44
 
45
  | Metric | Value |
46
  | --- | --- |
47
- | humaneval-python | 46.341 |
48
 
49
  [Big Code Models Leaderboard](https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard)
50
 
@@ -65,11 +65,11 @@ CodeLlama-13B: 35.07
65
  [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
66
  | Metric | Value |
67
  | --- | --- |
68
- | ARC | |
69
- | HellaSwag | |
70
- | MMLU | |
71
- | TruthfulQA | |
72
- | Average | |
73
 
74
  ## Parameters
75
 
 
24
  metrics:
25
  - name: pass@1
26
  type: pass@1
27
+ value: 47.561
28
  verified: false
29
  ---
30
 
 
44
 
45
  | Metric | Value |
46
  | --- | --- |
47
+ | humaneval-python | 47.561 |
48
 
49
  [Big Code Models Leaderboard](https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard)
50
 
 
65
  [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
66
  | Metric | Value |
67
  | --- | --- |
68
+ | ARC | 59.64 |
69
+ | HellaSwag | 82.25 |
70
+ | MMLU | 61.33 |
71
+ | TruthfulQA | 48.45 |
72
+ | Average | 62.92 |
73
 
74
  ## Parameters
75