Update README.md
Browse files
README.md
CHANGED
|
@@ -38,6 +38,7 @@ llava-dinov2-internlm2-7b-v1 | 64.0 | 65.2 | 62.9 | 61.6 | 45.3
|
|
| 38 |
```
|
| 39 |
git clone https://github.com/InternLM/xtuner
|
| 40 |
pip install -e ./xtuner[deepspeed]
|
|
|
|
| 41 |
cd ./xtuner
|
| 42 |
# Now replace the source code files with the modifed version in modified_xtuner_code directory
|
| 43 |
```
|
|
@@ -106,9 +107,11 @@ def process(dataset,
|
|
| 106 |
use_varlen_attn=False,
|
| 107 |
input_ids_with_output=True,
|
| 108 |
with_image_token=False,
|
| 109 |
-
map_num_proc=32): # modify it to
|
| 110 |
```
|
| 111 |
|
|
|
|
|
|
|
| 112 |
## Data prepration
|
| 113 |
1. File structure
|
| 114 |
|
|
|
|
| 38 |
```
|
| 39 |
git clone https://github.com/InternLM/xtuner
|
| 40 |
pip install -e ./xtuner[deepspeed]
|
| 41 |
+
apt install git-lfs
|
| 42 |
cd ./xtuner
|
| 43 |
# Now replace the source code files with the modifed version in modified_xtuner_code directory
|
| 44 |
```
|
|
|
|
| 107 |
use_varlen_attn=False,
|
| 108 |
input_ids_with_output=True,
|
| 109 |
with_image_token=False,
|
| 110 |
+
map_num_proc=32): # modify it to a smaller number, e.g., 4
|
| 111 |
```
|
| 112 |
|
| 113 |
+
6. If you fail to load the model, check whether you installed git-lfs and actually downloaded the model file.
|
| 114 |
+
|
| 115 |
## Data prepration
|
| 116 |
1. File structure
|
| 117 |
|