Update README.md
Browse files
README.md
CHANGED
|
@@ -158,7 +158,7 @@ With vision:
|
|
| 158 |
|
| 159 |
## Metrics
|
| 160 |
|
| 161 |
-
| Model | MathVista (CoT) | MMMU (CoT) | ChartQA (CoT) | DocVQA (ANLS) | VQAv2 (VQA Match) |
|
| 162 |
|:----------------------------:|:---------------:|:----------:|:-------------:|:--------------:|:-----------------:|:-----------:|:-----------:|
|
| 163 |
| **Pixtral Large** | **<u>69.4</u>** | 64.0 | 88.1 | **<u>93.3</u>**| **<u>80.9</u>** | 93.8 | 7.4 |
|
| 164 |
| Gemini-1.5 Pro (measured) | 67.8 | 66.3 | 83.8 | 92.3 | 70.6 | **<u>94.6</u>**| 6.8 |
|
|
|
|
| 158 |
|
| 159 |
## Metrics
|
| 160 |
|
| 161 |
+
| Model | MathVista (CoT) | MMMU (CoT) | ChartQA (CoT) | DocVQA (ANLS) | VQAv2 (VQA Match) | AI2D (BBox) | MM MT-Bench |
|
| 162 |
|:----------------------------:|:---------------:|:----------:|:-------------:|:--------------:|:-----------------:|:-----------:|:-----------:|
|
| 163 |
| **Pixtral Large** | **<u>69.4</u>** | 64.0 | 88.1 | **<u>93.3</u>**| **<u>80.9</u>** | 93.8 | 7.4 |
|
| 164 |
| Gemini-1.5 Pro (measured) | 67.8 | 66.3 | 83.8 | 92.3 | 70.6 | **<u>94.6</u>**| 6.8 |
|