Instructions to use reaperdoesntknow/MoA-400M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use reaperdoesntknow/MoA-400M with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="reaperdoesntknow/MoA-400M") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import MoAMetricLM model = MoAMetricLM.from_pretrained("reaperdoesntknow/MoA-400M", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use reaperdoesntknow/MoA-400M with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "reaperdoesntknow/MoA-400M" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "reaperdoesntknow/MoA-400M", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/reaperdoesntknow/MoA-400M
- SGLang
How to use reaperdoesntknow/MoA-400M with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "reaperdoesntknow/MoA-400M" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "reaperdoesntknow/MoA-400M", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "reaperdoesntknow/MoA-400M" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "reaperdoesntknow/MoA-400M", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use reaperdoesntknow/MoA-400M with Docker Model Runner:
docker model run hf.co/reaperdoesntknow/MoA-400M
Commit History
Yesterday
-
keeper: refresh 2026-11-15
Verified signature3a111c4
2 days ago
-
keeper: refresh 2026-11-14
Verified signature679668b
3 days ago
-
keeper: refresh 2026-11-13
Verified signature6a09156
4 days ago
-
keeper: refresh 2026-11-12
Verified signature7b31f11
5 days ago
-
keeper: refresh 2026-11-11
Verified signaturebe32095
6 days ago
-
keeper: refresh 2026-11-10
Verified signature78c46b7
7 days ago
-
keeper: refresh 2026-11-09
Verified signatureb600587
8 days ago
-
keeper: refresh 2026-11-08
Verified signature71d0065
13 days ago
-
keeper: refresh 2026-11-03
Verified signatureba4c9fd
14 days ago
-
keeper: refresh 2026-11-02
Verified signature4efbbd4
15 days ago
-
keeper: refresh 2026-11-01
Verified signature093c1ab
16 days ago
-
keeper: refresh 2026-10-31
Verified signature321cf7b
17 days ago
-
keeper: refresh 2026-10-30
Verified signature5ef1c11
18 days ago
-
keeper: refresh 2026-10-29
Verified signaturee2333a5
19 days ago
-
keeper: refresh 2026-10-28
Verified signature7c6e093
20 days ago
-
keeper: refresh 2026-10-27
Verified signatured89358c
21 days ago
-
keeper: refresh 2026-10-26
Verified signature2b4eb97
22 days ago
-
keeper: refresh 2026-10-25
Verified signature1aabe72
23 days ago
-
keeper: refresh 2026-10-24
Verified signature89547a3
24 days ago
-
keeper: refresh 2026-10-23
Verified signature43929c5
25 days ago
-
keeper: refresh 2026-10-22
Verified signatureb4f3e1f
26 days ago
-
keeper: refresh 2026-10-21
Verified signature076686d
27 days ago
-
keeper: refresh 2026-10-20
Verified signature6df67f4
28 days ago
-
keeper: refresh 2026-10-19
Verified signature3f949e8
29 days ago
-
keeper: refresh 2026-10-18
Verified signaturef92c274
-
keeper: refresh 2026-10-14
Verified signatureb30b61e
-
keeper: refresh 2026-10-13
Verified signature95c4f09
-
keeper: refresh 2026-10-03
Verified signature225ef2b
-
keeper: refresh 2026-10-02
Verified signaturec0ceca6
-
keeper: refresh 2026-10-01
Verified signaturee1b42e5
-
keeper: refresh 2026-09-30
Verified signature5c9693b
-
keeper: refresh 2026-09-29
Verified signaturee1020e0
-
keeper: refresh 2026-09-28
Verified signature4aa4d01
-
keeper: refresh 2026-09-27
Verified signature97e0352
-
keeper: refresh 2026-09-26
Verified signaturea2161a6
-
keeper: refresh 2026-09-25
Verified signaturebe7fd9c
-
keeper: refresh 2026-09-24
Verified signature34fcdcb
-
keeper: refresh 2026-09-23
Verified signaturec470cbc
-
keeper: refresh 2026-09-22
Verified signatureaa188dd
-
keeper: refresh 2026-09-21
Verified signature8295e7a
-
keeper: refresh 2026-09-20
Verified signaturea6f3833
-
keeper: refresh 2026-09-19
Verified signature34fddd3
-
keeper: refresh 2026-09-18
Verified signature6393e35
-
keeper: refresh 2026-09-16
Verified signature104dfa3
-
keeper: refresh 2026-09-15
Verified signaturebe157d3
-
keeper: refresh 2026-09-14
Verified signatureb015872
-
keeper: refresh 2026-09-13
Verified signature0eb7155
-
keeper: refresh 2026-09-12
Verified signature91f7378
-
keeper: refresh 2026-09-11
Verified signaturee677438
-
keeper: refresh 2026-09-10
Verified signatureba64455