Update README.md
Browse files
README.md
CHANGED
|
@@ -17,22 +17,22 @@ We have a growing Discord community of others interested in using Intel for AI/M
|
|
| 17 |
- Find documentation on the Optimum-CLI export process [here](https://huggingface.co/docs/optimum/main/en/intel/openvino/export)
|
| 18 |
- Use my HF space [Echo9Zulu/Optimum-CLI-Tool_tool](https://huggingface.co/spaces/Echo9Zulu/Optimum-CLI-Tool_tool) to build commands and execute locally
|
| 19 |
|
| 20 |
-
## This repo contains OpenVINO quantizations of
|
| 21 |
|
| 22 |
-
I reccomend starting with **
|
| 23 |
|
| 24 |
To download individual models from this repo use the provided snippet:
|
| 25 |
|
| 26 |
```
|
| 27 |
from huggingface_hub import snapshot_download
|
| 28 |
|
| 29 |
-
repo_id = "Echo9Zulu/
|
| 30 |
|
| 31 |
# Choose the weights you want
|
| 32 |
-
repo_directory = "
|
| 33 |
|
| 34 |
# Where you want to save it
|
| 35 |
-
local_dir = "./
|
| 36 |
|
| 37 |
snapshot_download(
|
| 38 |
repo_id=repo_id,
|
|
|
|
| 17 |
- Find documentation on the Optimum-CLI export process [here](https://huggingface.co/docs/optimum/main/en/intel/openvino/export)
|
| 18 |
- Use my HF space [Echo9Zulu/Optimum-CLI-Tool_tool](https://huggingface.co/spaces/Echo9Zulu/Optimum-CLI-Tool_tool) to build commands and execute locally
|
| 19 |
|
| 20 |
+
## This repo contains OpenVINO quantizations of SicariusSicariiStuff/Phi-lthy4.
|
| 21 |
|
| 22 |
+
I reccomend starting with **Phi-lthy4-int4_sym-awq-ov**
|
| 23 |
|
| 24 |
To download individual models from this repo use the provided snippet:
|
| 25 |
|
| 26 |
```
|
| 27 |
from huggingface_hub import snapshot_download
|
| 28 |
|
| 29 |
+
repo_id = "Echo9Zulu/Phi-lthy4-OpenVINO"
|
| 30 |
|
| 31 |
# Choose the weights you want
|
| 32 |
+
repo_directory = "Phi-lthy4-int4_sym-awq-ov"
|
| 33 |
|
| 34 |
# Where you want to save it
|
| 35 |
+
local_dir = "./Echo9Zulu_Phi-lthy4-OpenVINO/Phi-lthy4-int4_sym-awq-ov"
|
| 36 |
|
| 37 |
snapshot_download(
|
| 38 |
repo_id=repo_id,
|