Requesting Addition to Vidore Leaderboard

#3
by pranshuchaurasia - opened

Hello LlamaIndex team,
I've been evaluating the vdr-2b-multi-v1 model using the Vidore benchmark, but I noticed that the model's score hasn't been uploaded to the Vidore leaderboard yet. Would it be possible to add the vdr-2b-multi-v1 score to the Vidore leaderboard for comparison with other models?
Also, I wanted to confirm the correct value for the --model-class parameter when running the benchmark. During my testing, I used "biqweb2" as the model class, but I'm not sure if this is correct. Could you please confirm the appropriate model class to use when benchmarking vdr-2b-multi-v1 with Vidore benchmark?
Thank you for your help and for making this model available to the community!

LlamaIndex org

Its on the leaderboard now (both v1 and v2 versions of vidore)

cheesyFishes changed discussion status to closed

Sign up or log in to comment