AI & ML interests

None defined yet.

Recent Activity

xiyang99 
authored 13 papers about 1 month ago
jeffboudier 
posted an update 2 months ago
view post
Post
2973
Quick 30s demo of the new Hub > Azure AI integration to deploy HF models in your own Azure account. Now with Py and CLI!

GG @alvarobartt @kramp @pagezyhf
danielhanchen 
posted an update 2 months ago
view post
Post
5806
Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!🐋
GGUFs: unsloth/DeepSeek-V3.1-GGUF

The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.

The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.

Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
danielhanchen 
posted an update 3 months ago