Member Junction
    Preparing search index...

    Interface AgentEvalExpectedOutcomes

    Expected outcomes for Agent Evaluation tests.

    interface AgentEvalExpectedOutcomes {
        expectedActions?: string[];
        expectedEntities?: string[];
        judgeValidationCriteria?: string[];
        responsePatterns?: string[];
        responseSchema?: Record<string, unknown>;
        sqlValidations?: { expectedResult: unknown; query: string }[];
    }
    Index

    Properties

    expectedActions? expectedEntities? judgeValidationCriteria? responsePatterns? responseSchema? sqlValidations?

    Properties

    expectedActions?: string[]

    Expected actions taken

    expectedEntities?: string[]

    Expected entities mentioned in response

    judgeValidationCriteria?: string[]

    Custom validation criteria for LLM judge

    responsePatterns?: string[]

    Expected response patterns (for regex matching)

    responseSchema?: Record<string, unknown>

    Schema for response validation

    sqlValidations?: { expectedResult: unknown; query: string }[]

    SQL queries to validate database state

    Settings

    Member Visibility

    On This Page

    Properties