README.md

Quantization made by Richard Erkhov.

Github

Discord

Request more models

tiny-random-GemmaForCausalLM - bnb 8bits

• Model creator: https://huggingface.co/fxmarty/
• Original model: https://huggingface.co/fxmarty/tiny-random-GemmaForCausalLM/

Original model description:

license: mit

This one with a custom config.head_dim as allowed by the architecture (see 7b model).