-
-
-
-
-
-
Inference Providers
Active filters:
6-bit
mlx-community/Kimi-Linear-48B-A3B-Instruct-6bit
Text Generation
•
49B
•
Updated
•
210
•
2
MaziyarPanahi/WizardLM-2-7B-GGUF
Text Generation
•
7B
•
Updated
•
87.4k
•
83
MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
2.73k
•
170
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
•
7B
•
Updated
•
115k
•
127
MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
84.6k
•
6
inferencerlabs/openai-gpt-oss-20b-MLX-6.5bit
Text Generation
•
21B
•
Updated
•
723
•
2
Minthy/GLM-4.5-Air-exl3-6bpw
Text Generation
•
41B
•
Updated
•
17
•
1
nightmedia/Ling-lite-1.5-2507-q6-hi-mlx
Text Generation
•
17B
•
Updated
•
21
•
1
mlx-community/Kimi-VL-A3B-Thinking-2506-6bit
Image-Text-to-Text
•
Updated
•
16
•
1
zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-6bpw
13B
•
Updated
•
3
•
2
mlx-community/Qwen3-VL-8B-Thinking-6bit
Image-Text-to-Text
•
Updated
•
243
•
2
mlx-community/Qwen3-VL-2B-Instruct-6bit
Image-Text-to-Text
•
0.8B
•
Updated
•
57
•
1
DeathGodlike/Impish-LongPen-12B_EXL3
Text Generation
•
Updated
•
1
•
1
inferencerlabs/MiniMax-M2-MLX-6.5bit
Text Generation
•
229B
•
Updated
•
1.41k
•
2
steampunque/Qwen3-VL-8B-Instruct-Hybrid-GGUF
8B
•
Updated
•
1
steampunque/Qwen3-VL-4B-Instruct-Hybrid-GGUF
4B
•
Updated
•
1
DeathGodlike/Chrysologus-12B_EXL3
Text Generation
•
Updated
•
1
DeathGodlike/Scarlet-Eclipse-12B_EXL3
Text Generation
•
Updated
•
1
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
•
Updated
•
1
•
1
MaziyarPanahi/phi-2-GGUF
Text Generation
•
3B
•
Updated
•
197
•
6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
108
•
6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
215
•
4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
142
•
5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
•
7B
•
Updated
•
132
•
3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
190
•
2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
50
•
2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
88
•
2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
84
•
1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
138
•
1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
•
7B
•
Updated
•
42
•
1