Update README.md
Browse files
README.md
CHANGED
|
@@ -107,7 +107,48 @@ At the time of submission, no formal bias or fairness evaluation has been conduc
|
|
| 107 |
|
| 108 |
Evaluation was conducted using **strict (exact match)** and **character-level** metrics on the MultiClinNER test set.
|
| 109 |
|
| 110 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 111 |
|
| 112 |
## Additional information
|
| 113 |
|
|
|
|
| 107 |
|
| 108 |
Evaluation was conducted using **strict (exact match)** and **character-level** metrics on the MultiClinNER test set.
|
| 109 |
|
| 110 |
+
## Evaluation Results (MTL, Multilingual + Multilabel - DISEASE)
|
| 111 |
+
|
| 112 |
+
| Language | Strict P | Strict R | Strict F1 | Char P | Char R | Char F1 |
|
| 113 |
+
|----------|---------:|---------:|----------:|-------:|-------:|--------:|
|
| 114 |
+
| es | 0.5024 | 0.5949 | 0.5448 | 0.6437 | 0.7488 | 0.6923 |
|
| 115 |
+
| it | 0.5202 | 0.5087 | 0.5144 | 0.6614 | 0.6380 | 0.6495 |
|
| 116 |
+
| ro | 0.5536 | 0.5693 | 0.5613 | 0.6938 | 0.7071 | 0.7004 |
|
| 117 |
+
| en | 0.5476 | 0.4907 | 0.5176 | 0.6825 | 0.5996 | 0.6384 |
|
| 118 |
+
| nl | 0.5118 | 0.5283 | 0.5199 | 0.6323 | 0.6417 | 0.6370 |
|
| 119 |
+
| sv | 0.4821 | 0.5416 | 0.5101 | 0.6027 | 0.6635 | 0.6316 |
|
| 120 |
+
| cz | 0.4802 | 0.5007 | 0.4902 | 0.6107 | 0.6242 | 0.6174 |
|
| 121 |
+
| **Average** | | | **0.5226** | | | **0.6524** |
|
| 122 |
+
|
| 123 |
+
---
|
| 124 |
+
|
| 125 |
+
## Evaluation Results (MTL, Multilingual + Multilabel - SYMPTOM)
|
| 126 |
+
|
| 127 |
+
| Language | Strict P | Strict R | Strict F1 | Char P | Char R | Char F1 |
|
| 128 |
+
|----------|---------:|---------:|----------:|-------:|-------:|--------:|
|
| 129 |
+
| es | 0.1862 | 0.1734 | 0.1796 | 0.3518 | 0.3208 | 0.3356 |
|
| 130 |
+
| it | 0.2087 | 0.1478 | 0.1730 | 0.3714 | 0.2564 | 0.3033 |
|
| 131 |
+
| ro | 0.1819 | 0.1430 | 0.1602 | 0.3452 | 0.2644 | 0.2995 |
|
| 132 |
+
| en | 0.2501 | 0.1568 | 0.1927 | 0.4264 | 0.2618 | 0.3244 |
|
| 133 |
+
| nl | 0.2609 | 0.2120 | 0.2339 | 0.3985 | 0.3149 | 0.3518 |
|
| 134 |
+
| sv | 0.2429 | 0.2080 | 0.2241 | 0.3932 | 0.3257 | 0.3563 |
|
| 135 |
+
| cz | 0.1872 | 0.1718 | 0.1792 | 0.3296 | 0.2917 | 0.3095 |
|
| 136 |
+
| **Average** | | | **0.1918** | | | **0.3258** |
|
| 137 |
+
|
| 138 |
+
---
|
| 139 |
+
|
| 140 |
+
## Evaluation Results (MTL, Multilingual + Multilabel - PROCEDURE)
|
| 141 |
+
|
| 142 |
+
| Language | Strict P | Strict R | Strict F1 | Char P | Char R | Char F1 |
|
| 143 |
+
|----------|---------:|---------:|----------:|-------:|-------:|--------:|
|
| 144 |
+
| es | 0.6119 | 0.6336 | 0.6226 | 0.7575 | 0.7769 | 0.7671 |
|
| 145 |
+
| it | 0.6094 | 0.5043 | 0.5519 | 0.7561 | 0.6209 | 0.6819 |
|
| 146 |
+
| ro | 0.6565 | 0.6351 | 0.6456 | 0.7914 | 0.7599 | 0.7753 |
|
| 147 |
+
| en | 0.6169 | 0.5757 | 0.5956 | 0.7757 | 0.7192 | 0.7464 |
|
| 148 |
+
| nl | 0.6266 | 0.6203 | 0.6234 | 0.7526 | 0.7404 | 0.7465 |
|
| 149 |
+
| sv | 0.6131 | 0.6317 | 0.6223 | 0.7448 | 0.7614 | 0.7530 |
|
| 150 |
+
| cz | 0.6104 | 0.6269 | 0.6185 | 0.7527 | 0.7644 | 0.7585 |
|
| 151 |
+
| **Average** | | | **0.6114** | | | **0.7470** |
|
| 152 |
|
| 153 |
## Additional information
|
| 154 |
|