TorchAO Quantized Qwen3
Collection
TorchAO quantized Qwen3 models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
•
5 items
•
Updated
pytorch
non-profit
AI & ML interests
An open source machine learning framework that accelerates the path from research prototyping to production deployment.
Recent Activity
jerryzh168
updated
a
collection
3 days ago
andrewor14
updated
2
models
7 days ago
andrewor14
published
2
models
7 days ago
jerryzh168
updated
a
model
10 days ago
jerryzh168
updated
3
models
12 days ago
jerryzh168
updated
2
models
16 days ago
Adding `safetensors` variant of this model
#3 opened 17 days ago
by
SFconvertbot
jerryzh168
updated
4
models
18 days ago
Post
1268
What other features would you like to see on the Trackio Dashboard? (
gradio-templates/trackio-dashboard)
marksaroufim
authored
a
paper
about 2 months ago
Post
4437
The Gradio x Agents x MCP hackathon keeps growing! We now have more $1,000,000 in credit for participants and and >$16,000 in cash prizes for winners.
We've kept registration open until the end of this week, so join and let's build cool stuff together as a community: https://huggingface.co/spaces/ysharma/gradio-hackathon-registration-2025
We've kept registration open until the end of this week, so join and let's build cool stuff together as a community: https://huggingface.co/spaces/ysharma/gradio-hackathon-registration-2025
Post
685
Let's go! Custom generation code has landed in
Have you designed a new cool KV cache? Maybe you're comparing new test-time compute ideas you've been researching? Have you found a way to do diffusion with existing models? You can now easily share your findings with the community with custom generation code, sharing the well-known
In a nutshell, we have expanded the support of custom modeling code on the Hub with *model-agnostic* custom generation code. Write for one model, reuse with any model -- hopefully, this will democratize access to new generation ideas 🫡
As a creator, you gain the ability to get your ideas in
💎 Resources 💎
- docs: https://huggingface.co/docs/transformers/generation_strategies#custom-decoding-methods
- minimal example: transformers-community/custom_generate_example
- discussion: transformers-community/support#10
transformers 🚀Have you designed a new cool KV cache? Maybe you're comparing new test-time compute ideas you've been researching? Have you found a way to do diffusion with existing models? You can now easily share your findings with the community with custom generation code, sharing the well-known
generate interface 🤓In a nutshell, we have expanded the support of custom modeling code on the Hub with *model-agnostic* custom generation code. Write for one model, reuse with any model -- hopefully, this will democratize access to new generation ideas 🫡
As a creator, you gain the ability to get your ideas in
transformers with minimal effort. You'll also have access to all Hub features: a landing page for your creation, discussions, usage metrics, ... 🤓💎 Resources 💎
- docs: https://huggingface.co/docs/transformers/generation_strategies#custom-decoding-methods
- minimal example: transformers-community/custom_generate_example
- discussion: transformers-community/support#10