Update README.md
Browse files
README.md
CHANGED
@@ -14,21 +14,21 @@ language:
|
|
14 |
|
15 |
We introduce the concept of semantic orientation, representing the object orientation condition on open vocabulary language.
|
16 |
The model is part of [SoFar](https://github.com/qizekun/SoFar), a 6-DoF system for spatial reasoning and robotic manipulation.
|
17 |
-
The released weights is on [Huggingface PointSO](https://huggingface.co/qizekun/PointSO), and the code is in the [orientation](
|
18 |
|
19 |
## Pretrain
|
20 |
Download the PointMAE as initialization.
|
21 |
```bash
|
22 |
wget https://github.com/Pang-Yatian/Point-MAE/releases/download/main/pretrain.pth -P orientation/
|
23 |
```
|
24 |
-
Perpare the OrienText300K dataset following [DATASET.md](
|
25 |
```bash
|
26 |
cd orientation
|
27 |
sh train_ddp.sh
|
28 |
```
|
29 |
|
30 |
## Finetune
|
31 |
-
Perpare the Open6DOR finetuning dataset following [DATASET.md](
|
32 |
The dataset is generated from isaac sim with different assets from Open6DOR.
|
33 |
Finetune PointSO will significantly improve the performance on Open6DOR rotation track & 6-DoF track.
|
34 |
We recommend using this version of the model for the Open6DOR V2 evaluation.
|
|
|
14 |
|
15 |
We introduce the concept of semantic orientation, representing the object orientation condition on open vocabulary language.
|
16 |
The model is part of [SoFar](https://github.com/qizekun/SoFar), a 6-DoF system for spatial reasoning and robotic manipulation.
|
17 |
+
The released weights is on [Huggingface PointSO](https://huggingface.co/qizekun/PointSO), and the code is in the [orientation](https://github.com/qizekun/SoFar/tree/main/orientation) folder.
|
18 |
|
19 |
## Pretrain
|
20 |
Download the PointMAE as initialization.
|
21 |
```bash
|
22 |
wget https://github.com/Pang-Yatian/Point-MAE/releases/download/main/pretrain.pth -P orientation/
|
23 |
```
|
24 |
+
Perpare the OrienText300K dataset following [DATASET.md](https://github.com/qizekun/SoFar/blob/main/datasets/DATASET.md).
|
25 |
```bash
|
26 |
cd orientation
|
27 |
sh train_ddp.sh
|
28 |
```
|
29 |
|
30 |
## Finetune
|
31 |
+
Perpare the Open6DOR finetuning dataset following [DATASET.md](https://github.com/qizekun/SoFar/blob/main/datasets/DATASET.md).
|
32 |
The dataset is generated from isaac sim with different assets from Open6DOR.
|
33 |
Finetune PointSO will significantly improve the performance on Open6DOR rotation track & 6-DoF track.
|
34 |
We recommend using this version of the model for the Open6DOR V2 evaluation.
|