David Kofler
koflerdavid
·
AI & ML interests
None yet
Recent Activity
liked
a model
9 days ago
unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF
reacted
to
danielhanchen's
post
with 🔥
9 days ago
Qwen3-Next can now be Run locally! (30GB RAM)
Instruct GGUF: https://huggingface.co/unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF
The models come in Thinking and Instruct versions and utilize a new architecture, allowing it to have ~10x faster inference than Qwen32B.
💜 Step-by-step Guide: https://docs.unsloth.ai/models/qwen3-next
Thinking GGUF: https://huggingface.co/unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF
liked
a model
9 days ago
ArliAI/GLM-4.5-Air-Derestricted
Organizations
None yet
fp16 version?
2
#5 opened over 1 year ago
by
david565
torch.cuda.OutOfMemoryError: CUDA out of memory.
1
#115 opened almost 2 years ago
by
SlyGoblin