Update README.md
Browse files
README.md
CHANGED
|
@@ -7,11 +7,12 @@ datasets:
|
|
| 7 |
- HuggingFaceH4/ultrafeedback_binarized
|
| 8 |
language:
|
| 9 |
- en
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
Optimum quantization using the command:
|
| 13 |
```bash
|
| 14 |
-
|
| 15 |
```
|
| 16 |
|
| 17 |
Usage example:
|
|
|
|
| 7 |
- HuggingFaceH4/ultrafeedback_binarized
|
| 8 |
language:
|
| 9 |
- en
|
| 10 |
+
inference: false
|
| 11 |
---
|
| 12 |
|
| 13 |
Optimum quantization using the command:
|
| 14 |
```bash
|
| 15 |
+
optimum-cli inc quantize --model TinyLlama/TinyLlama-1.1B-Chat-v1.0 --output ./TinyLlama
|
| 16 |
```
|
| 17 |
|
| 18 |
Usage example:
|