Create README.md
#1
by
						
yangwang92
	
							
						- opened
							
					
    	
        README.md
    ADDED
    
    | @@ -0,0 +1,22 @@ | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            ---
         | 
| 2 | 
            +
            license: mit
         | 
| 3 | 
            +
            base_model:
         | 
| 4 | 
            +
            - deepseek-ai/DeepSeek-R1
         | 
| 5 | 
            +
            base_model_relation: quantized
         | 
| 6 | 
            +
            tags:
         | 
| 7 | 
            +
            - VPTQ
         | 
| 8 | 
            +
            - Quantized
         | 
| 9 | 
            +
            - Quantization
         | 
| 10 | 
            +
            ---
         | 
| 11 | 
            +
             | 
| 12 | 
            +
            **Disclaimer**: 
         | 
| 13 | 
            +
             | 
| 14 | 
            +
            The model is reproduced based on the paper *VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models* [github](https://github.com/microsoft/vptq) and [arXiv](https://arxiv.org/abs/2409.17066)
         | 
| 15 | 
            +
             | 
| 16 | 
            +
            The model itself is sourced from a community release. 
         | 
| 17 | 
            +
             | 
| 18 | 
            +
            It is intended only for experimental purposes. 
         | 
| 19 | 
            +
             | 
| 20 | 
            +
            Users are responsible for any consequences arising from the use of this model.
         | 
| 21 | 
            +
             | 
| 22 | 
            +
            ```
         | 
