README.md

metadata

library_name: ExLlama2
pipeline_tag: text-generation
base_model: openai-community/gpt2
base_model_relation: quantized

Exl2 quants for gpt2

Automatically quantized using the auto quant script from hf-scripts

BPW:

6.0
6.5
8.0
measurement.json