alpindale
/

Mistral-7B-Instruct-v0.2-EETQ

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

alpindale commited on Apr 15, 2024

Commit

0ea83af

·

verified ·

1 Parent(s): 938772c

Create README.md

Files changed (1) hide show

README.md +4 -0

README.md ADDED Viewed

	@@ -0,0 +1,4 @@

+Model quantized using a modified [EETQ](https://github.com/NetEase-FuXi/EETQ) repo. Currently working on
+decoupling its kernels from CUTLASS to make this a bit easier to use.
+8bits.