Hugging Face's logo

amd
/
gemma-2-2b-onnx-ryzenai-hybrid

ONNX
Chinese
English
Model card Files
xet
Community

amd/gemma-2-2b

  • Introduction

    This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment.

  • Quantization Strategy

    • AWQ / Group 128 / Asymmetric / BFP16 activations / UINT4 weights

  • Quick Start

For quickstart, refer to Ryzen AI doucmentation

Evaluation scores

The MMLU scores are, astronomy: 55.26, philosophy: 56.91 and management: 69.9.

License

Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.

Downloads last month
15
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for amd/gemma-2-2b-onnx-ryzenai-hybrid

Base model

google/gemma-2-2b
Quantized
(53)
this model

Collection including amd/gemma-2-2b-onnx-ryzenai-hybrid