Hugging Face's logo

Spaces:
PatronusAI
/
enterprise_scenarios_leaderboard
Runtime error

App Files Community
12

Cluj-Napoca failed

#9
by Mihaiii - opened
Discussion
Mihaiii

Hi!

I submitted 2 models (see below) and both failed, which is weird because I can see validation results for 4 out of 6 evals for both of them.

Do the eval hit a timeout? Could we rerun?

https://huggingface.co/datasets/PatronusAI/requests/blob/main/Mihaiii/Cluj-Napoca-0.3_eval_request_False_float16_Original.json

https://huggingface.co/datasets/PatronusAI/requests/blob/main/Mihaiii/Cluj-Napoca-0.2_eval_request_False_bfloat16_Original.json

Mihaiii

@sunitha-ravi There definitely seems to be a timeout of 2 hours and 50 minutes. Could you please increase it and run the above?

sunitha-ravi

Sure I can submit a re-rerun. Let me check the logs to see if there is some other issue

Mihaiii

@sunitha-ravi Any news? What are the constrains for submissions? (ex: total eval time under X minutes, number of params under X billions etc.)

Sign up or log in to comment