mrmage/gemma-2-2b-Q4_K_M-GGUF
Text Generation • 3B • Updated • 46
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
24,833
Active filters: llama-cpp
mrmage/gemma-2-2b-it-Q3_K_M-GGUF
Text Generation • 3B • Updated • 69
kpranav22/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 33 • 1
zachaman/chpr3019-updated-Q4_K_M-GGUF
14B • Updated • 3
reach-vb/OpenELM-450M-Instruct-Q8_0-GGUF
0.5B • Updated • 13
Ramikan-BR/Qwen2-0.5B-v20-Q8_0-GGUF
0.5B • Updated • 1
qnixsynapse/Gemma-V2-2B-Instruct-GGUF
Text Generation • 3B • Updated • 39
NikolayKozloff/Llama-3.1-SauerkrautLM-8b-Instruct-Q8_0-GGUF
8B • Updated • 18 • 1
Lambent/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation • 14B • Updated • 9
reach-vb/OpenELM-1_1B-Instruct-Q8_0-GGUF
1B • Updated • 5
reach-vb/OpenELM-3B-Instruct-Q8_0-GGUF
3B • Updated • 7
adrlau/noredu-it-Q4_K_M-GGUF
8B • Updated
cha9ro/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation • 3B • Updated • 19
Fischerboot/german-2b-Q8_0-GGUF
2B • Updated • 12
latentheat/Moistral-11B-v3-Q5_K_M-GGUF
11B • Updated • 1
swilde42/Meta-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 11
wiktorwojcik112/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation • 3B • Updated • 30
reach-vb/Meta-Llama-3.1-8B-Q8_0-GGUF
Text Generation • 8B • Updated • 12
reach-vb/Meta-Llama-3.1-8B-Q2_K-GGUF
Text Generation • 8B • Updated • 12 • 2
SansarK/TinyLlama_v1.1-Q5_K_S-GGUF
1B • Updated • 10
aifoundry-org/granite-8b-code-instruct-128k-Q4_K_M-GGUF
Text Generation • 8B • Updated • 31 • 1
adrlau/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF
Text Generation • 4B • Updated • 7 • 1
Niansuh/Mistral-Nemo-Instruct-2407-Q8_0-GGUF
12B • Updated • 9
kaetemi/Meta-Llama-3-8B-Q2_K-GGUF
Text Generation • 8B • Updated • 9
lomaky/Gemma-2-2b-it-chat-doctor-Q4_K_M-GGUF
3B • Updated • 10
Sovenok-Hacker/gemma-2-2b-it-Q4_0-GGUF
Text Generation • 3B • Updated • 33 • 1
shoemaker/L3.1-8B-sunfall-v0.6.1-dpo-Q8_0-GGUF
8B • Updated • 15 • 1
pegasus912/Nemo-12B-Marlin-v2-Q4_K_M-GGUF
12B • Updated • 3
kaetemi/Meta-Llama-3-8B-Q4_K_M-GGUF-c3o12
Text Generation • 8B • Updated • 3
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12
Text Generation • 8B • Updated • 6