500 Server Error

#162
by ZhenlongDai - opened

I am encountering an issue when trying to access the MTEB: Massive Text Embedding Benchmark leaderboard on Hugging Face. When I attempt to view the leaderboard, I receive a 500 Server Error with the following error message:

TypeError: argument of type 'bool' is not iterable

As a result, the leaderboard data is not loading, and I am unable to view the results.

Massive Text Embedding Benchmark org

Interesting. The errors seem to appear inside of Gradio. I have done a factory reset of the space if it happens again, I will try to debug and if needed file a bug report.

Massive Text Embedding Benchmark org

Up and running again!

KennethEnevoldsen changed discussion status to closed

It happens again, I still can not view the leaderboard.

Massive Text Embedding Benchmark org

I'm working on it

Massive Text Embedding Benchmark org
โ€ข
edited Mar 28

Leaderboard is up. It seems that huggingface spaces had some problems and lates relaese of pydantic broke gradio https://github.com/gradio-app/gradio/issues/10649#issuecomment-2759383234, https://github.com/gradio-app/gradio/issues/10662. Will try to create min representation to report issue. Maybe we should add lock file for leaderboard building

UPD. Gradio 5.16.0 is not compatible with pydantic 2.11. Greater versions of gradio working fine

Massive Text Embedding Benchmark org

Thanks for taking the time, @Samoed ! Sounds like we should set this up with uv and a lock file.

Massive Text Embedding Benchmark org

Sign up or log in to comment