Quantization made by Richard Erkhov.

[Github](https://github.com/RichardErkhov)

[Discord](https://discord.gg/pvy7H8DZMG)

[Request more models](https://github.com/RichardErkhov/quant_request)


tiny-random-GemmaForCausalLM - bnb 8bits
- Model creator: https://huggingface.co/fxmarty/
- Original model: https://huggingface.co/fxmarty/tiny-random-GemmaForCausalLM/




Original model description:
---
license: mit
---

This one with a custom `config.head_dim` as allowed by the architecture (see 7b model).