can be run with my experimental llama.cpp fork, im currently working on a draft pr to iron out issues. Remember this is experimental there can be issues! https://github.com/ggml-org/llama.cpp/pull/17454

Downloads last month
225
GGUF
Model size
16B params
Architecture
llada2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for wsbagnsv1/LLaDA2.0-mini-preview-GGUF

Quantized
(2)
this model