Update README.md
Browse files
README.md
CHANGED
|
@@ -2,4 +2,5 @@
|
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
A model trained using lilLM: https://github.com/CohleM/lilLM
|
| 5 |
-
|
|
|
|
|
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
A model trained using lilLM: https://github.com/CohleM/lilLM
|
| 5 |
+
|
| 6 |
+
The model is ~40M parameter and trained on 10B tokens from OpenWebText: https://huggingface.co/datasets/Skylion007/openwebtext
|