Quantization Process?

#6
by yangchen123 - opened

Thank you for the author's contribution. I have tried this quantitative model and its performance is surprisingly good. I feel it can rival the online version on the official website. But I would like to inquire how the model was quantified? Which quantitative tool is being used specifically? Does autoawq seem to not support deepseek?

Sign up or log in to comment