---
license: apache-2.0
base_model:
- Vikhrmodels/Vikhr-Llama3.1-8B-Instruct-R-21-09-24
base_model_relation: quantized
pipeline_tag: text-generation
library_name: safetensors
tags:
- exl3
- 4-bit
- 6-bit
- 8-bit
---
## EXL3 quants: [ [H8-4.0BPW](https://huggingface.co/DeathGodlike/Vikhr-Llama3.1-8B-Instruct-R-21-09-24_EXL3/tree/H8-4.0BPW) | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Vikhr-Llama3.1-8B-Instruct-R-21-09-24_EXL3/tree/H8-6.0BPW) | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Vikhr-Llama3.1-8B-Instruct-R-21-09-24_EXL3/tree/H8-8.0BPW) ]

# Original model: [Vikhr-Llama3.1-8B-Instruct-R-21-09-24](https://huggingface.co/Vikhrmodels/Vikhr-Llama3.1-8B-Instruct-R-21-09-24) by [Vikhrmodels](https://huggingface.co/Vikhrmodels)