Hugging Face's logo

CohereLabs
/
c4ai-command-r-v01-4bit

Text Generation
Transformers
Safetensors
cohere
conversational
custom_code
text-generation-inference
4-bit precision
bitsandbytes
Model card Files
xet
Community
12

GGUF format for LM-Studio etc.

#1
by ahmetab06 - opened
Discussion
ahmetab06

Can u add to GGUF format for run it with LM-Studio

ahmetab06 changed discussion status to closed
ahmetab06 changed discussion status to open
flymonk

check this:

https://huggingface.co/andrewcanis/c4ai-command-r-v01-GGUF

blankreg

Unfortunately that's not the 4bit version

alexrs changed discussion status to closed

Sign up or log in to comment