numen-tech
/

FuseChat-Gemma-2-9B-Instruct-w4a16g128asym

Text Generation

4-bit precision

Model card Files Files and versions

4-bit OmniQuant quantized version of FuseChat-Gemma-2-9B-Instruct for inference with the Private LLM app.

Downloads last month: -

Model tree for numen-tech/FuseChat-Gemma-2-9B-Instruct-w4a16g128asym

Base model

google/gemma-2-9b

Finetuned

google/gemma-2-9b-it

Quantized

(154)

this model