gguf, inference, etc
#9
by
oliviermills
- opened
What’s the plan on getting gguf and quantized versions… can we get update on inference providers serving this, and benchmark results for working in real world applications: retrieval, tool calling, etc.
The only way any of these EU-ready more ethical models are going to get anywhere is if they are easily picked up by builders and work in existing AI application frameworks.