AI & ML interests

Unofficial org for community upload of Mistral's Open Source models.

Recent Activity

danielhanchenΒ 
posted an update 6 days ago
view post
Post
4082
Introducing Unsloth for AMD πŸš€
You can now train & run LLMs on your AMD hardware

β€’ We collaborated with AMD to enable you to train & run 500+ models on AMD GPUs
β€’ Works on Windows, WSL, Linux
β€’ Train Qwen, Gemma on just 3GB VRAM

GitHub: https://github.com/unslothai/unsloth
Blog + Guide: https://unsloth.ai/docs/basics/amd
  • 3 replies
Β·
danielhanchenΒ 
posted an update 8 days ago
danielhanchenΒ 
posted an update 12 days ago
danielhanchenΒ 
posted an update 16 days ago
danielhanchenΒ 
posted an update 19 days ago
danielhanchenΒ 
posted an update about 1 month ago
view post
Post
3338
1-bit GLM-5.2 GGUF vs. Claude 4.8 Opus vs. GPT-5.5

We gave 3 models the same prompt and compared one-shot outputs.

The 1-bit GLM-5.2 GGUF ran locally on a Mac Studio M3 Ultra with 256GB RAM at ~21.6 tok/s.

Which output do you like best?
GGUF: unsloth/GLM-5.2-GGUF
  • 3 replies
Β·
danielhanchenΒ 
posted an update about 1 month ago
danielhanchenΒ 
posted an update about 2 months ago
danielhanchenΒ 
posted an update about 2 months ago
danielhanchenΒ 
posted an update about 2 months ago
view post
Post
9341
Gemma 4 12B can now run locally on just 8GB RAM via Dynamic GGUFs.

Google's new model, Gemma 4 12B Unified supports image, audio and 256K context.
You can run and train the model via Unsloth Studio.

GGUF: unsloth/gemma-4-12b-it-GGUF
Guide: https://unsloth.ai/docs/models/gemma-4
  • 5 replies
Β·