numen-tech's picture
Add weights
8f4e87f
metadata
license: apache-2.0
base_model: deepcogito/cogito-v1-preview-qwen-32B
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit GPTQ quantized version of cogito-v1-preview-qwen-32B for use with the Private LLM app.