Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
kaitchup
/
Qwen2.5-Coder-32B-Instruct-AutoRound-GPTQ-4bit
like
3
Follow
The Kaitchup
75
Text Generation
Transformers
Safetensors
English
qwen2
auto-gptq
AutoRound
conversational
text-generation-inference
4-bit precision
gptq
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
Having issue using the model with vllm
#1 opened 8 months ago by
imadoualid
imadoualid