Optionalengine: RubricOracleEngineReadonlytypeUnique type identifier for this oracle. Used in test configuration to specify which oracles to run.
Evaluate the test output.
Evaluation input (test, expected/actual outputs, target entity, user)
Oracle-specific configuration
Promise resolving to oracle result
Judges a test run with a rubric. The subject is the test run and the context is the test. A host can inject the engine; otherwise the call uses the input provider. The oracle config's
evaluatoris an evaluator selection (IRubricEvaluatorSelection); LLM SinglePass when it is absent.