Update README.md
Browse files
README.md
CHANGED
@@ -17,22 +17,22 @@ We have a growing Discord community of others interested in using Intel for AI/M
|
|
17 |
- Find documentation on the Optimum-CLI export process [here](https://huggingface.co/docs/optimum/main/en/intel/openvino/export)
|
18 |
- Use my HF space [Echo9Zulu/Optimum-CLI-Tool_tool](https://huggingface.co/spaces/Echo9Zulu/Optimum-CLI-Tool_tool) to build commands and execute locally
|
19 |
|
20 |
-
## This repo contains OpenVINO quantizations of
|
21 |
|
22 |
-
I reccomend starting with **
|
23 |
|
24 |
To download individual models from this repo use the provided snippet:
|
25 |
|
26 |
```
|
27 |
from huggingface_hub import snapshot_download
|
28 |
|
29 |
-
repo_id = "Echo9Zulu/
|
30 |
|
31 |
# Choose the weights you want
|
32 |
-
repo_directory = "
|
33 |
|
34 |
# Where you want to save it
|
35 |
-
local_dir = "./
|
36 |
|
37 |
snapshot_download(
|
38 |
repo_id=repo_id,
|
|
|
17 |
- Find documentation on the Optimum-CLI export process [here](https://huggingface.co/docs/optimum/main/en/intel/openvino/export)
|
18 |
- Use my HF space [Echo9Zulu/Optimum-CLI-Tool_tool](https://huggingface.co/spaces/Echo9Zulu/Optimum-CLI-Tool_tool) to build commands and execute locally
|
19 |
|
20 |
+
## This repo contains OpenVINO quantizations of SicariusSicariiStuff/Phi-lthy4.
|
21 |
|
22 |
+
I reccomend starting with **Phi-lthy4-int4_sym-awq-ov**
|
23 |
|
24 |
To download individual models from this repo use the provided snippet:
|
25 |
|
26 |
```
|
27 |
from huggingface_hub import snapshot_download
|
28 |
|
29 |
+
repo_id = "Echo9Zulu/Phi-lthy4-OpenVINO"
|
30 |
|
31 |
# Choose the weights you want
|
32 |
+
repo_directory = "Phi-lthy4-int4_sym-awq-ov"
|
33 |
|
34 |
# Where you want to save it
|
35 |
+
local_dir = "./Echo9Zulu_Phi-lthy4-OpenVINO/Phi-lthy4-int4_sym-awq-ov"
|
36 |
|
37 |
snapshot_download(
|
38 |
repo_id=repo_id,
|