llmixer
/

Midnight-Rose-103B-v2.0.3-4.0bpw-h6-exl2

Create README.md

a7bc109 verified almost 2 years ago

249 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 4.0bpw
  - h6
  - exl2

Exllamav2 4.0bpw h6 quant for Midnight-Rose-103B-v2.0.3.

Default calibration dataset.