Update README.md
Browse files
README.md
CHANGED
@@ -78,4 +78,21 @@ The image is a close-up shot of a vibrant garden scene, focusing on a pink cosmo
|
|
78 |
* **Main Subject:** A bright pink cosmos flower is the central focus. The petals are a delicate shade of pink with a slightly darker pink vein pattern. The
|
79 |
"""
|
80 |
|
81 |
-
~~~
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
78 |
* **Main Subject:** A bright pink cosmos flower is the central focus. The petals are a delicate shade of pink with a slightly darker pink vein pattern. The
|
79 |
"""
|
80 |
|
81 |
+
~~~
|
82 |
+
|
83 |
+
|
84 |
+
## Generate the model
|
85 |
+
|
86 |
+
Here is the sample command to reproduce the model.
|
87 |
+
|
88 |
+
```bash
|
89 |
+
pip install git+https://github.com/intel/auto-round.git@main
|
90 |
+
auto-round-mllm \
|
91 |
+
--model google/gemma-3-27b-it \
|
92 |
+
--device 0 \
|
93 |
+
--bits 4 \
|
94 |
+
--batch_size 1 \
|
95 |
+
--gradient_accumulate_steps 8 \
|
96 |
+
--format 'auto_round' \
|
97 |
+
--output_dir "./tmp_autoround"
|
98 |
+
```
|