Bagel 8x7B evaluation failed

#516
by Dampfinchen - opened
Open LLM Leaderboard org

Hi ! Can you directly link to the request file and not the commit that is modifying it ? Thanks ! :)

Hi ! Can you directly link to the request file and not the commit that is modifying it ? Thanks ! :)

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/jondurbin/bagel-8x7b-v0.2_eval_request_False_bfloat16_Original.json

Is that what you asked for?

Open LLM Leaderboard org

Yes, thanks ! Well it seems like everything went fine but the model was tagged as FAILED anyway. I updated the request file so that your model shows on the leaderboard, so you should be good !

SaylorTwift changed discussion status to closed
Dampfinchen changed discussion status to open

Yes, thanks ! Well it seems like everything went fine but the model was tagged as FAILED anyway. I updated the request file so that your model shows on the leaderboard, so you should be good !

Apologies, but it's still not showing on the Leaderboard. Same as with Eric Hartford's Dolphin Mixtral series.

Thank you, Bagel 8x7B is showing up now.

Dampfinchen changed discussion status to closed

Sign up or log in to comment