Spaces:
Running
Running
Update utils.py
Browse files
utils.py
CHANGED
@@ -37,9 +37,7 @@ This comprehensive suite enables robust evaluation of multimodal embedding model
|
|
37 |
|
38 |
**IMPORTANT NOTES Regarding the old MMEB-V1 leaderboard:**
|
39 |
MMEB-V1 is now part of the Image section of MMEB-V2, and the results on its leaderboard have been merged into the MMEB-V2 Image leaderboard.
|
40 |
-
We won't be accepting new submissions to the old V1 leaderboard anymore, and will remove it from this web page soon.
|
41 |
For researchers relying on MMEB-V1, we recommend transitioning to MMEB-V2 for more comprehensive evaluation metrics and support.
|
42 |
-
**On the V2 Image leaderboard, models from the old V1 leaderboard are missing detailed scores of each dataset. We hope the authors of the models on V1 leaderboard could rerun your models using our updated V2 pipeline, and provide us the scores sheet with the new format, so that we can make them consistent with the other models' formats.**
|
43 |
|
44 |
| [**📈Overview**](https://tiger-ai-lab.github.io/VLM2Vec/) | [**Github**](https://github.com/TIGER-AI-Lab/VLM2Vec)
|
45 |
| [**📖MMEB-V2/VLM2Vec-V2 Paper**](https://arxiv.org/abs/2507.04590)
|
|
|
37 |
|
38 |
**IMPORTANT NOTES Regarding the old MMEB-V1 leaderboard:**
|
39 |
MMEB-V1 is now part of the Image section of MMEB-V2, and the results on its leaderboard have been merged into the MMEB-V2 Image leaderboard.
|
|
|
40 |
For researchers relying on MMEB-V1, we recommend transitioning to MMEB-V2 for more comprehensive evaluation metrics and support.
|
|
|
41 |
|
42 |
| [**📈Overview**](https://tiger-ai-lab.github.io/VLM2Vec/) | [**Github**](https://github.com/TIGER-AI-Lab/VLM2Vec)
|
43 |
| [**📖MMEB-V2/VLM2Vec-V2 Paper**](https://arxiv.org/abs/2507.04590)
|