ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ
10B
•
Updated
•
3
•
25
Mengzhao Chen
ChenMnZ
AI & ML interests
model compression
Recent Activity
upvoted
a
paper
about 10 hours ago
INT v.s. FP: A Comprehensive Study of Fine-Grained Low-bit Quantization
Formats
commented on
a paper
about 14 hours ago
INT v.s. FP: A Comprehensive Study of Fine-Grained Low-bit Quantization
Formats
upvoted
a
paper
5 days ago
Parallel Loop Transformer for Efficient Test-Time Computation Scaling
Organizations
None yet
ChenMnZ/Llama-3-70b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
37B
•
Updated
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128-BitBLAS
Text Generation
•
20B
•
Updated
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
5B
•
Updated
•
15
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64-BitBLAS
Text Generation
•
3B
•
Updated
•
1
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128-BitBLAS
Text Generation
•
3B
•
Updated
•
1
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
5B
•
Updated
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
3B
•
Updated
•
1
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
3B
•
Updated
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128-BitBLAS
Text Generation
•
37B
•
Updated
•
3
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64-BitBLAS
Text Generation
•
21B
•
Updated
•
10
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128-GPTQ
Text Generation
•
2B
•
Updated
ChenMnZ/Llama-3-70b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
21B
•
Updated
•
1
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128-GPTQ
Text Generation
•
2B
•
Updated
•
3
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64-GPTQ
Text Generation
•
2B
•
Updated
ChenMnZ/Llama-3-70b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
20B
•
Updated
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128-GPTQ
Text Generation
•
2B
•
Updated
•
5
•
1
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128-GPTQ
Text Generation
•
2B
•
Updated
•
2
•
1
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64-GPTQ
Text Generation
•
2B
•
Updated
•
3
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128
Text Generation
•
11B
•
Updated
•
1
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128-GPTQ
Text Generation
•
11B
•
Updated
•
1
ChenMnZ/Llama-2-7b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
4B
•
Updated
•
1
ChenMnZ/Llama-2-7b-EfficientQAT-w2g64-BitBLAS
Text Generation
•
2B
•
Updated
•
3
ChenMnZ/Llama-2-7b-EfficientQAT-w2g128-BitBLAS
Text Generation
•
2B
•
Updated
•
1
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64-GPTQ
Text Generation
•
8B
•
Updated
ChenMnZ/Llama-2-70b-EfficientQAT-w4g128-BitBLAS
Text Generation
•
36B
•
Updated
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128-GPTQ
Text Generation
•
7B
•
Updated
•
11
ChenMnZ/Llama-3-70b-EfficientQAT-w4g128-GPTQ
Text Generation
•
11B
•
Updated
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128
Text Generation
•
2B
•
Updated
•
1
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w3g128
Text Generation
•
2B
•
Updated
•
1