Update README.md
Browse files
README.md
CHANGED
|
@@ -18,15 +18,17 @@ This is the **medium-2** model of the NanoTranslator, currently supported only i
|
|
| 18 |
|
| 19 |
The ONNX version of the model is also available in the repository.
|
| 20 |
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
|
| 24 |
-
|
|
| 25 |
-
|
|
| 26 |
-
|
|
| 27 |
-
|
|
| 28 |
-
|
|
| 29 |
-
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
- **P.** - Parameters (in million)
|
| 32 |
- **V.** - vocab size
|
|
|
|
| 18 |
|
| 19 |
The ONNX version of the model is also available in the repository.
|
| 20 |
|
| 21 |
+
All models are collected in the [NanoTranslator Collection](https://huggingface.co/collections/Mxode/nanotranslator-66e1de2ba352e926ae865bd2).
|
| 22 |
+
|
| 23 |
+
| | P. | Arch. | Act. | V. | H. | I. | L. | A.H. | K.H. | Tie |
|
| 24 |
+
| :--: | :-----: | :--: | :--: | :--: | :-----: | :---: | :------: | :--: | :--: | :--: |
|
| 25 |
+
| [XXL](https://huggingface.co/Mxode/NanoTranslator-XXL) | 100 | LLaMA | SwiGLU | 16000 | 768 | 4096 | 8 | 24 | 8 | True |
|
| 26 |
+
| [XL](https://huggingface.co/Mxode/NanoTranslator-XL) | 78 | LLaMA | GeGLU | 16000 | 768 | 4096 | 6 | 24 | 8 | True |
|
| 27 |
+
| [L](https://huggingface.co/Mxode/NanoTranslator-L) | 49 | LLaMA | GeGLU | 16000 | 512 | 2816 | 8 | 16 | 8 | True |
|
| 28 |
+
| [M2](https://huggingface.co/Mxode/NanoTranslator-M2) | 22 | Qwen2 | GeGLU | 4000 | 432 | 2304 | 6 | 24 | 8 | True |
|
| 29 |
+
| [M](https://huggingface.co/Mxode/NanoTranslator-M) | 22 | LLaMA | SwiGLU | 8000 | 256 | 1408 | 16 | 16 | 4 | True |
|
| 30 |
+
| [S](https://huggingface.co/Mxode/NanoTranslator-S) | 9 | LLaMA | SwiGLU | 4000 | 168 | 896 | 16 | 12 | 4 | True |
|
| 31 |
+
| [XS](https://huggingface.co/Mxode/NanoTranslator-XS) | 2 | LLaMA | SwiGLU | 2000 | 96 | 512 | 12 | 12 | 4 | True |
|
| 32 |
|
| 33 |
- **P.** - Parameters (in million)
|
| 34 |
- **V.** - vocab size
|