Update README.md
Browse files
README.md
CHANGED
@@ -1,12 +1,33 @@
|
|
1 |
---
|
2 |
license: bsd-3-clause
|
3 |
-
|
4 |
-
|
5 |
-
- model_hub_mixin
|
6 |
-
- pytorch_model_hub_mixin
|
7 |
---
|
8 |
|
9 |
-
|
10 |
-
|
11 |
-
- Paper:
|
12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: bsd-3-clause
|
3 |
+
language:
|
4 |
+
- en
|
|
|
|
|
5 |
---
|
6 |
|
7 |
+
# MEMFOF-Tartan-T-TSKH-spring
|
8 |
+
|
9 |
+
<a href="" style="text-decoration: none;">π Paper</a> | <a href="https://msu-video-group.github.io/memfof" style="text-decoration: none;">π Project Page</a> | <a href="https://github.com/msu-video-group/memfof" style="text-decoration: none;">π» Code</a> | <a href="https://colab.research.google.com/github/msu-video-group/memfof/blob/dev/demo.ipynb" style="text-decoration: none;">π Colab</a> | <a href="https://huggingface.co/spaces/egorchistov/MEMFOF" style="text-decoration: none;">π€ Demo</a>
|
10 |
+
|
11 |
+
π This is a MEMFOF checkpoint trained **from MEMFOF-Tartan-T-TSKH** checkpoint on the **Spring** dataset.
|
12 |
+
|
13 |
+
β
**Note:** This model is intended for submission to **Spring benchmark**.
|
14 |
+
|
15 |
+
## π οΈ Usage
|
16 |
+
|
17 |
+
```shell
|
18 |
+
git clone https://github.com/msu-video-group/memfof.git
|
19 |
+
cd memfof
|
20 |
+
pip3 install -r requirements.txt
|
21 |
+
```
|
22 |
+
|
23 |
+
```python
|
24 |
+
import torch
|
25 |
+
from core.memfof import MEMFOF
|
26 |
+
|
27 |
+
device = "cuda" if torch.cuda.is_available() else "cpu"
|
28 |
+
model = MEMFOF.from_pretrained("egorchistov/MEMFOF-Tartan-T-TSKH-spring").eval().to(device)
|
29 |
+
|
30 |
+
with torch.inference_mode():
|
31 |
+
example_input = torch.randint(0, 256, [1, 3, 3, 1080, 1920], device=device) # [B=1, T=3, C=3, H=1080, W=1920]
|
32 |
+
backward_flow, forward_flow = model(example_input).unbind(dim=1) # [B=1, C=2, H=1080, W=1920]
|
33 |
+
```
|