AWQ quant for the 162B REAP distill?
#5
by
BW-Projects
- opened
Hello!
Thanks for your awesome AWQ quant services.
Will you also do the new REAP distill?
That would be awesome.
Would be awesome to add 40% compressed version as well
We're very interested in this. It seems that pruning 30% doesn't cause significant performance loss. We'll give it a try
Awesome, thank you! :)