Update README.md
Browse files
README.md
CHANGED
@@ -38,6 +38,7 @@ llava-dinov2-internlm2-7b-v1 | 64.0 | 65.2 | 62.9 | 61.6 | 45.3
|
|
38 |
```
|
39 |
git clone https://github.com/InternLM/xtuner
|
40 |
pip install -e ./xtuner[deepspeed]
|
|
|
41 |
cd ./xtuner
|
42 |
# Now replace the source code files with the modifed version in modified_xtuner_code directory
|
43 |
```
|
@@ -106,9 +107,11 @@ def process(dataset,
|
|
106 |
use_varlen_attn=False,
|
107 |
input_ids_with_output=True,
|
108 |
with_image_token=False,
|
109 |
-
map_num_proc=32): # modify it to
|
110 |
```
|
111 |
|
|
|
|
|
112 |
## Data prepration
|
113 |
1. File structure
|
114 |
|
|
|
38 |
```
|
39 |
git clone https://github.com/InternLM/xtuner
|
40 |
pip install -e ./xtuner[deepspeed]
|
41 |
+
apt install git-lfs
|
42 |
cd ./xtuner
|
43 |
# Now replace the source code files with the modifed version in modified_xtuner_code directory
|
44 |
```
|
|
|
107 |
use_varlen_attn=False,
|
108 |
input_ids_with_output=True,
|
109 |
with_image_token=False,
|
110 |
+
map_num_proc=32): # modify it to a smaller number, e.g., 4
|
111 |
```
|
112 |
|
113 |
+
6. If you fail to load the model, check whether you installed git-lfs and actually downloaded the model file.
|
114 |
+
|
115 |
## Data prepration
|
116 |
1. File structure
|
117 |
|