Const
How long a judge waits for each model call when the oracle config sets no timeoutMS: two minutes. A judge call is one prompt over one test's trace, so this is generous; it is there so a hung call fails the oracle instead of hanging the test run.
timeoutMS
How long a judge waits for each model call when the oracle config sets no
timeoutMS: two minutes. A judge call is one prompt over one test's trace, so this is generous; it is there so a hung call fails the oracle instead of hanging the test run.