Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 12.2k

Running on CPU Upgrade

Hi Open LLM LB Team,

Thanks for all the help so far, I am not sure what is causing this, but there seems to be pattern in failure for all Orca Mini v* 70B models.

I have submitted these models as recently yesterday and as far as more then a month ago but every-time after successful submission there models are failing.

I am opening the discussion as needed, but is there any pattern of these failures, such as bigger param size like 70B.

Here is recent Orca Mini V9_4 70B failed request

https://huggingface.co/datasets/open-llm-leaderboard/requests/commit/30b4d9f396d34d9f0638979416eba11de2975eec

Could you please resubmit.

Thanks again for Open LLM LB

Regards,
Pankaj