added more clarity about mlx-lm
Browse files
README.md
CHANGED
|
@@ -280,7 +280,7 @@ base_model:
|
|
| 280 |
|
| 281 |
# MLX Runtime (Apple silicon) — Added Files & Usage
|
| 282 |
|
| 283 |
-
This fork adds a lightweight MLX runtime so you can run the original MobileLLM‑R1‑950M weights with Apple’s MLX on Apple silicon. It keeps the original weights (`model.safetensors`) and tokenizer; only the runtime is added.
|
| 284 |
|
| 285 |
## Technical Documentation
|
| 286 |
|
|
@@ -334,6 +334,8 @@ uv sync
|
|
| 334 |
|
| 335 |
# 3. (Optional) Add the torch group if you plan to customize/train models
|
| 336 |
uv sync --extra torch
|
|
|
|
|
|
|
| 337 |
|
| 338 |
### Without uv
|
| 339 |
If you prefer pip/venv, a `requirements.txt` is provided:
|
|
|
|
| 280 |
|
| 281 |
# MLX Runtime (Apple silicon) — Added Files & Usage
|
| 282 |
|
| 283 |
+
This fork adds a lightweight MLX runtime so you can run the original MobileLLM‑R1‑950M weights with Apple’s MLX on Apple silicon. It keeps the original weights (`model.safetensors`) and tokenizer; only the runtime is added. Additional code is provided to reproduce the (also included) mlx-lm conversion and 4-bit quant, though some manual modifications are needed to mlx-lm at this time to get it to run.
|
| 284 |
|
| 285 |
## Technical Documentation
|
| 286 |
|
|
|
|
| 334 |
|
| 335 |
# 3. (Optional) Add the torch group if you plan to customize/train models
|
| 336 |
uv sync --extra torch
|
| 337 |
+
```
|
| 338 |
+
|
| 339 |
|
| 340 |
### Without uv
|
| 341 |
If you prefer pip/venv, a `requirements.txt` is provided:
|