Instructions to use aelgendy/QModel with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use aelgendy/QModel with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf aelgendy/QModel:Q4_K_M # Run inference directly in the terminal: llama cli -hf aelgendy/QModel:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf aelgendy/QModel:Q4_K_M # Run inference directly in the terminal: llama cli -hf aelgendy/QModel:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf aelgendy/QModel:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf aelgendy/QModel:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf aelgendy/QModel:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf aelgendy/QModel:Q4_K_M
Use Docker
docker model run hf.co/aelgendy/QModel:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use aelgendy/QModel with Ollama:
ollama run hf.co/aelgendy/QModel:Q4_K_M
- Unsloth Desktop
- Pi
How to use aelgendy/QModel with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf aelgendy/QModel:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "aelgendy/QModel:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use aelgendy/QModel with Docker Model Runner:
docker model run hf.co/aelgendy/QModel:Q4_K_M
- Lemonade
How to use aelgendy/QModel with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull aelgendy/QModel:Q4_K_M
Run and chat with the model
lemonade run user.QModel-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use aelgendy/QModel with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf aelgendy/QModel:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default aelgendy/QModel:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use aelgendy/QModel with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf aelgendy/QModel:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "aelgendy/QModel:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Upload folder using huggingface_hub
Browse files- .vscode/launch.json +0 -30
- .vscode/settings.json +0 -3
- QModel.index +0 -0
- metadata.json +3 -128
.vscode/launch.json
DELETED
|
@@ -1,30 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
// Use IntelliSense to learn about possible attributes.
|
| 3 |
-
// Hover to view descriptions of existing attributes.
|
| 4 |
-
// For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387
|
| 5 |
-
"version": "0.2.0",
|
| 6 |
-
"configurations": [
|
| 7 |
-
{
|
| 8 |
-
"name": "Python Debugger: FastAPI",
|
| 9 |
-
"type": "debugpy",
|
| 10 |
-
"request": "launch",
|
| 11 |
-
"module": "uvicorn",
|
| 12 |
-
"args": [
|
| 13 |
-
"main:app",
|
| 14 |
-
"--reload"
|
| 15 |
-
],
|
| 16 |
-
"jinja": true
|
| 17 |
-
},
|
| 18 |
-
{
|
| 19 |
-
"name": "Python Debugger: FastAPI",
|
| 20 |
-
"type": "debugpy",
|
| 21 |
-
"request": "launch",
|
| 22 |
-
"module": "uvicorn",
|
| 23 |
-
"args": [
|
| 24 |
-
"main:app",
|
| 25 |
-
"--reload"
|
| 26 |
-
],
|
| 27 |
-
"jinja": true
|
| 28 |
-
}
|
| 29 |
-
]
|
| 30 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
.vscode/settings.json
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"postman.settings.dotenv-detection-notification-visibility": false
|
| 3 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
QModel.index
CHANGED
|
Binary files a/QModel.index and b/QModel.index differ
|
|
|
metadata.json
CHANGED
|
@@ -1,128 +1,3 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
"arabic": "ููุง ุฃููููููุง ุงูููุฐูููู ุขู
ููููุง ุงุณูุชูุนูููููุง ุจูุงูุตููุจูุฑู ููุงูุตููููุงุฉู...",
|
| 5 |
-
"english": "O you who have believed, seek help through patience and prayer...",
|
| 6 |
-
"source": "Surah Al-Baqarah 2:153",
|
| 7 |
-
"type": "quran"
|
| 8 |
-
},
|
| 9 |
-
{
|
| 10 |
-
"id": "1:1-7",
|
| 11 |
-
"arabic": "ุจูุณูู
ู ุงูููููู ุงูุฑููุญูู
ููู ุงูุฑููุญููู
ู... ุงููุฏูููุง ุงูุตููุฑูุงุทู ุงููู
ูุณูุชููููู
ู",
|
| 12 |
-
"english": "In the name of Allah, the Entirely Merciful, the Especially Merciful... Guide us to the straight path",
|
| 13 |
-
"source": "Surah Al-Fatihah 1:1-7",
|
| 14 |
-
"type": "quran"
|
| 15 |
-
},
|
| 16 |
-
{
|
| 17 |
-
"id": "2:255",
|
| 18 |
-
"arabic": "ุงูููููู ููุง ุฅููููู ุฅููููุง ูููู ุงููุญูููู ุงููููููููู
ู...",
|
| 19 |
-
"english": "Allah - there is no deity except Him, the Ever-Living, the Sustainer of [all] existence...",
|
| 20 |
-
"source": "Surah Al-Baqarah 2:255 (Ayat al-Kursi)",
|
| 21 |
-
"type": "quran"
|
| 22 |
-
},
|
| 23 |
-
{
|
| 24 |
-
"id": "112:1-4",
|
| 25 |
-
"arabic": "ูููู ูููู ุงูููููู ุฃูุญูุฏู... ููููู
ู ููููู ููููู ููููููุง ุฃูุญูุฏู",
|
| 26 |
-
"english": "Say, He is Allah, [who is] One... And there is none co-equal to Him.",
|
| 27 |
-
"source": "Surah Al-Ikhlas 112:1-4",
|
| 28 |
-
"type": "quran"
|
| 29 |
-
},
|
| 30 |
-
{
|
| 31 |
-
"id": "2:286",
|
| 32 |
-
"arabic": "ููุง ููููููููู ุงูููููู ููููุณูุง ุฅููููุง ููุณูุนูููุง...",
|
| 33 |
-
"english": "Allah does not charge a soul except [with that within] its capacity...",
|
| 34 |
-
"source": "Surah Al-Baqarah 2:286",
|
| 35 |
-
"type": "quran"
|
| 36 |
-
},
|
| 37 |
-
{
|
| 38 |
-
"id": "3:103",
|
| 39 |
-
"arabic": "ููุงุนูุชูุตูู
ููุง ุจูุญูุจููู ุงูููููู ุฌูู
ููุนูุง ููููุง ุชูููุฑูููููุง...",
|
| 40 |
-
"english": "And hold firmly to the rope of Allah all together and do not become divided...",
|
| 41 |
-
"source": "Surah Al-Imran 3:103",
|
| 42 |
-
"type": "quran"
|
| 43 |
-
},
|
| 44 |
-
{
|
| 45 |
-
"id": "5:8",
|
| 46 |
-
"arabic": "ููุง ุฃููููููุง ุงูููุฐูููู ุขู
ููููุง ููููููุง ูููููุงู
ูููู ููููููู ุดูููุฏูุงุกู ุจูุงููููุณูุทู...",
|
| 47 |
-
"english": "O you who have believed, be persistently standing firm for Allah, witnesses in justice...",
|
| 48 |
-
"source": "Surah Al-Ma'idah 5:8",
|
| 49 |
-
"type": "quran"
|
| 50 |
-
},
|
| 51 |
-
{
|
| 52 |
-
"id": "94:5",
|
| 53 |
-
"arabic": "ููุฅูููู ู
ูุนู ุงููุนูุณูุฑู ููุณูุฑูุง",
|
| 54 |
-
"english": "For indeed, with hardship [will be] ease.",
|
| 55 |
-
"source": "Surah Ash-Sharh 94:5",
|
| 56 |
-
"type": "quran"
|
| 57 |
-
},
|
| 58 |
-
{
|
| 59 |
-
"id": "bukhari_1",
|
| 60 |
-
"arabic": "ุฅููููู
ูุง ุงููุฃูุนูู
ูุงูู ุจูุงูููููููุงุชู...",
|
| 61 |
-
"english": "Actions are judged by intentions...",
|
| 62 |
-
"reference": "Sahih al-Bukhari 1",
|
| 63 |
-
"type": "hadith"
|
| 64 |
-
},
|
| 65 |
-
{
|
| 66 |
-
"id": "bukhari_8",
|
| 67 |
-
"arabic": "ุจููููู ุงูุฅูุณููุงู
ู ุนูููู ุฎูู
ูุณู...",
|
| 68 |
-
"english": "Islam is built upon five [pillars]...",
|
| 69 |
-
"reference": "Sahih al-Bukhari 8",
|
| 70 |
-
"type": "hadith"
|
| 71 |
-
},
|
| 72 |
-
{
|
| 73 |
-
"id": "muslim_1",
|
| 74 |
-
"arabic": "ุงูุฅููู
ูุงูู ุฃููู ุชูุคูู
ููู ุจูุงูููููู ููู
ููุงุฆูููุชููู...",
|
| 75 |
-
"english": "Faith is to believe in Allah, His angels...",
|
| 76 |
-
"reference": "Sahih Muslim 1",
|
| 77 |
-
"type": "hadith"
|
| 78 |
-
},
|
| 79 |
-
{
|
| 80 |
-
"id": "muslim_1907",
|
| 81 |
-
"arabic": "ู
ููู ุตูุงู
ู ุฑูู
ูุถูุงูู ุฅููู
ูุงููุง ููุงุญูุชูุณูุงุจูุง...",
|
| 82 |
-
"english": "Whoever fasts Ramadan with faith and seeking reward...",
|
| 83 |
-
"reference": "Sahih Muslim 1907",
|
| 84 |
-
"type": "hadith"
|
| 85 |
-
},
|
| 86 |
-
{
|
| 87 |
-
"id": "ahmad_3784",
|
| 88 |
-
"arabic": "ุจูุฏูุฃู ุงูุฅูุณููุงูู
ู ุบูุฑููุจูุง ููุณูููุนููุฏู ููู
ูุง ุจูุฏูุฃู ุบูุฑููุจูุง ููุทููุจูู ููููุบูุฑูุจูุงุกู",
|
| 89 |
-
"english": "Islam began as something strange and will revert to being strange as it began, so give glad tidings to the strangers.",
|
| 90 |
-
"reference": "Musnad Ahmad 3784",
|
| 91 |
-
"type": "hadith"
|
| 92 |
-
},
|
| 93 |
-
{
|
| 94 |
-
"id": "ahmad_2107",
|
| 95 |
-
"arabic": "ุฃูุญูุจูู ุงูุฏููููู ุฅูููู ุงูููููู ุงููุญูููููููููุฉู ุงูุณููู
ูุญูุฉู",
|
| 96 |
-
"english": "The most beloved of religions to Allah is the easy monotheism (Hanifiyyah).",
|
| 97 |
-
"reference": "Musnad Ahmad 2107",
|
| 98 |
-
"type": "hadith"
|
| 99 |
-
},
|
| 100 |
-
{
|
| 101 |
-
"id": "ahmad_8030",
|
| 102 |
-
"arabic": "ุงููู
ูุคูู
ููู ู
ูุฑูุขุฉู ุฃูุฎูููู",
|
| 103 |
-
"english": "The believer is a mirror for his brother.",
|
| 104 |
-
"reference": "Musnad Ahmad 8030",
|
| 105 |
-
"type": "hadith"
|
| 106 |
-
},
|
| 107 |
-
{
|
| 108 |
-
"id": "bukhari_6018",
|
| 109 |
-
"arabic": "ู
ููู ููุงูู ููุคูู
ููู ุจูุงูููููู ููุงููููููู
ู ุงูุขุฎูุฑู ููููููุญูุณููู ุฅูููู ุฌูุงุฑููู...",
|
| 110 |
-
"english": "Whoever believes in Allah and the Last Day should be kind to his neighbor...",
|
| 111 |
-
"reference": "Sahih al-Bukhari 6018",
|
| 112 |
-
"type": "hadith"
|
| 113 |
-
},
|
| 114 |
-
{
|
| 115 |
-
"id": "tirmidhi_2003",
|
| 116 |
-
"arabic": "ุฃูููู
ููู ุงููู
ูุคูู
ูููููู ุฅููู
ูุงููุง ุฃูุญูุณูููููู
ู ุฎูููููุง...",
|
| 117 |
-
"english": "The most complete of believers in faith are those with the best character...",
|
| 118 |
-
"reference": "Jami` at-Tirmidhi 2003",
|
| 119 |
-
"type": "hadith"
|
| 120 |
-
},
|
| 121 |
-
{
|
| 122 |
-
"id": "ibnmajah_224",
|
| 123 |
-
"arabic": "ุทูููุจู ุงููุนูููู
ู ููุฑููุถูุฉู ุนูููู ููููู ู
ูุณูููู
ู...",
|
| 124 |
-
"english": "Seeking knowledge is an obligation upon every muslim...",
|
| 125 |
-
"reference": "Sunan Ibn Majah 224",
|
| 126 |
-
"type": "hadith"
|
| 127 |
-
}
|
| 128 |
-
]
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:740d04c5ce81a535e242d7d006c8829ebc29233b51f9843ae40457986f9d8091
|
| 3 |
+
size 88267665
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|