cicdatopea commited on
Commit
3b3808a
·
verified ·
1 Parent(s): 4510380

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -78,4 +78,21 @@ The image is a close-up shot of a vibrant garden scene, focusing on a pink cosmo
78
  * **Main Subject:** A bright pink cosmos flower is the central focus. The petals are a delicate shade of pink with a slightly darker pink vein pattern. The
79
  """
80
 
81
- ~~~
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
78
  * **Main Subject:** A bright pink cosmos flower is the central focus. The petals are a delicate shade of pink with a slightly darker pink vein pattern. The
79
  """
80
 
81
+ ~~~
82
+
83
+
84
+ ## Generate the model
85
+
86
+ Here is the sample command to reproduce the model.
87
+
88
+ ```bash
89
+ pip install git+https://github.com/intel/auto-round.git@main
90
+ auto-round-mllm \
91
+ --model google/gemma-3-27b-it \
92
+ --device 0 \
93
+ --bits 4 \
94
+ --batch_size 1 \
95
+ --gradient_accumulate_steps 8 \
96
+ --format 'auto_round' \
97
+ --output_dir "./tmp_autoround"
98
+ ```