Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

turboderp
/
gemma-2-9b-it-exl2

Model card Files Files and versions
xet
Community
1
gemma-2-9b-it-exl2 / README.md
turboderp's picture
turboderp
Update README.md
92da41c verified about 2 years ago
preview code
|
Raw
History Blame Contribute Delete
1.04 kB
metadata
license: gemma

EXL2 quants of gemma-2-9b-it

2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
5.50 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json