Winfred's picture

Winfred

xkie

·

AI & ML interests

AI & ML

Recent Activity

replied to merterbak's post about 2 months ago

Here’s a cool paper I found: “Massive Image Embedding Benchmark (MIEB).” It is a new tool to test how good image embedding models are. It has 130 different tasks grouped into 8 categories, like image search, classification, clustering similar images, answering questions based on images, and understanding documents. It even covers 38 different languages. The authors tested 50 models and found that no single model was best at everything. Some models were great at recognizing text inside images but struggled to handle complicated tasks like matching images and text that appear together. Paper: https://arxiv.org/pdf/2504.10471v1 Code: https://github.com/embeddings-benchmark/mteb

reacted to merterbak's post with 🔥 about 2 months ago

Here’s a cool paper I found: “Massive Image Embedding Benchmark (MIEB).” It is a new tool to test how good image embedding models are. It has 130 different tasks grouped into 8 categories, like image search, classification, clustering similar images, answering questions based on images, and understanding documents. It even covers 38 different languages. The authors tested 50 models and found that no single model was best at everything. Some models were great at recognizing text inside images but struggled to handle complicated tasks like matching images and text that appear together. Paper: https://arxiv.org/pdf/2504.10471v1 Code: https://github.com/embeddings-benchmark/mteb

View all activity

Organizations

None yet

xkie's activity

replied to merterbak's post about 2 months ago

We need more research like this

reacted to merterbak's post with 🔥 about 2 months ago

Post

2139

Here’s a cool paper I found: “Massive Image Embedding Benchmark (MIEB).” It is a new tool to test how good image embedding models are. It has 130 different tasks grouped into 8 categories, like image search, classification, clustering similar images, answering questions based on images, and understanding documents. It even covers 38 different languages.

The authors tested 50 models and found that no single model was best at everything. Some models were great at recognizing text inside images but struggled to handle complicated tasks like matching images and text that appear together.

Paper: https://arxiv.org/pdf/2504.10471v1
Code: https://github.com/embeddings-benchmark/mteb

2 replies

·