Introduce a timeout on testing if model takes longer than a set amount of time

#1134
by mrdayl - opened

I believe im guily of causing a slow down on one of my models that had a typo in the chat template that would only cause looped COT, I just want to confirm if there is a timeout that should this occour the tests will kill the model after a set amount of test time to prevent locking up the system.

mrdayl changed discussion status to closed

Sign up or log in to comment