allenai
/

FlexOlmo-7x7B-1T

Text Generation

Mixture of Experts

Model card Files Files and versions

swj0419 commited on Jun 20

Commit

e6dca5e

·

1 Parent(s): 3f911e8

eval

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -59,9 +59,7 @@ print(tokenizer.decode(out[0]))
 | [Reddit](https://huggingface.co/allenai/Flex-reddit-2x7B-1T) | 64.7 | 36.5 | 56.1 | 25.5 | 35.5 | 19.7 | 2.5 | 54.1 | 8.6 | 32.7 | 1.7 | **30.7** |
 | **Combined**  |
 | BTM (top-2) | 68.7 | 57.7 | 59.4 | 28.3 | 43.2 | 44.3 | 23.1 | 73.6 | 54.4 | 46.3 | **24.0** | **47.6** |
-| 🔥 **FlexOlmo-7x7B-1T (no router training)** | 70.4 | 60.1 | 60.2 | 30.5 | 47.3 | 47.9 | 79.6 | 66.3 | 60.1 | **53.9** | 14.6 | **53.7** |
-| [FlexOlmo-7x7B-1T-RT](https://huggingface.co/allenai/FlexOlmo-7x7B-1T-RT) | **70.8** | **59.8** | **60.4** | 30.9 | **45.1** | **46.4** | 48.5 | **80.7** | 62.2 | 54.3 | 17.2 | **52.4** |
 # Citation

 | [Reddit](https://huggingface.co/allenai/Flex-reddit-2x7B-1T) | 64.7 | 36.5 | 56.1 | 25.5 | 35.5 | 19.7 | 2.5 | 54.1 | 8.6 | 32.7 | 1.7 | **30.7** |
 | **Combined**  |
 | BTM (top-2) | 68.7 | 57.7 | 59.4 | 28.3 | 43.2 | 44.3 | 23.1 | 73.6 | 54.4 | 46.3 | **24.0** | **47.6** |
+| 🔥 **FlexOlmo-7x7B-1T** | 70.4 | 60.1 | 60.2 | 30.5 | 47.3 | 47.9 | 79.6 | 66.3 | 60.1 | **53.9** | 14.6 | **53.7** |
 # Citation