robbiemu commited on
Commit
9b1f436
·
verified ·
1 Parent(s): c45463c

added more clarity about mlx-lm

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -280,7 +280,7 @@ base_model:
280
 
281
  # MLX Runtime (Apple silicon) — Added Files & Usage
282
 
283
- This fork adds a lightweight MLX runtime so you can run the original MobileLLM‑R1‑950M weights with Apple’s MLX on Apple silicon. It keeps the original weights (`model.safetensors`) and tokenizer; only the runtime is added.
284
 
285
  ## Technical Documentation
286
 
@@ -334,6 +334,8 @@ uv sync
334
 
335
  # 3. (Optional) Add the torch group if you plan to customize/train models
336
  uv sync --extra torch
 
 
337
 
338
  ### Without uv
339
  If you prefer pip/venv, a `requirements.txt` is provided:
 
280
 
281
  # MLX Runtime (Apple silicon) — Added Files & Usage
282
 
283
+ This fork adds a lightweight MLX runtime so you can run the original MobileLLM‑R1‑950M weights with Apple’s MLX on Apple silicon. It keeps the original weights (`model.safetensors`) and tokenizer; only the runtime is added. Additional code is provided to reproduce the (also included) mlx-lm conversion and 4-bit quant, though some manual modifications are needed to mlx-lm at this time to get it to run.
284
 
285
  ## Technical Documentation
286
 
 
334
 
335
  # 3. (Optional) Add the torch group if you plan to customize/train models
336
  uv sync --extra torch
337
+ ```
338
+
339
 
340
  ### Without uv
341
  If you prefer pip/venv, a `requirements.txt` is provided: