Latxa 7b Instruct GGUF
Provided files
| Name | Quant method | Bits | Size | Max RAM required | Use case |
|---|---|---|---|---|---|
| latxa-7b-v1-instruct-q8_0.gguf | 8 bits | 7 GB | 8,2 GB | Fits in a RTX 3060 12Gb |
- Downloads last month
- 8
Hardware compatibility
Log In
to view the estimation
We're not able to determine the quantization variants.