Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
pytorch 's Collections
TorchAO Quantized Qwen3
TorchAO Quantized Phi-4-mini-instruct

TorchAO Quantized Qwen3

updated 16 days ago

TorchAO quantized Qwen3 models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch

Upvote
-

  • pytorch/Qwen3-8B-INT4

    Text Generation • Updated about 1 month ago • 121 • 2

  • pytorch/Qwen3-4B-INT8-INT4

    Text Generation • Updated Sep 11 • 1.72k • 2

  • pytorch/Qwen3-32B-FP8

    Text Generation • Updated about 1 month ago • 31

  • pytorch/Qwen3-8B-AWQ-INT4

    Text Generation • Updated about 1 month ago • 127 • 1

  • pytorch/Qwen3-8B-QAT-INT4

    Text Generation • Updated 20 days ago • 425 • 1
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs