Member Junction
    Preparing search index...

    Interface OracleInput

    Oracle evaluation input

    interface OracleInput {
        actualOutput?: unknown;
        contextUser: UserInfo;
        expectedOutput?: unknown;
        judgeEvidence?: JudgeOutputEvidence;
        provider?: IMetadataProvider;
        targetEntity?: unknown;
        test: MJTestEntity;
        testRunId?: string;
    }
    Index

    Properties

    actualOutput? contextUser expectedOutput? judgeEvidence? provider? targetEntity? test testRunId?

    Properties

    actualOutput?: unknown

    Actual output from execution

    contextUser: UserInfo

    User context

    expectedOutput?: unknown

    Expected output from test definition

    judgeEvidence?: JudgeOutputEvidence

    Labeled, size-bounded evidence for judge oracles: the agent's final message, its final payload and the artifacts the run produced. Set by drivers whose output is not all in the payload (an agent that answers in its message, or one that leaves a manifest in its payload and the substance in an artifact). Judge oracles read it in place of actualOutput when present; actualOutput itself is unchanged, so structural oracles (schema, exact-match) are unaffected.

    provider?: IMetadataProvider

    Optional metadata provider to use for entity/SQL operations during oracle evaluation. If supplied, oracles should use this provider instead of the global Metadata.Provider to participate in the same transaction/connection as the calling test run.

    targetEntity?: unknown

    Target entity (e.g., AgentRun)

    test: MJTestEntity

    The test being evaluated

    testRunId?: string

    The test run being judged. The rubric oracle uses this as the subject record.

    Settings

    Member Visibility

    On This Page

    Properties