Member Junction
    Preparing search index...

    Single turn in a multi-turn test

    interface AgentEvalTurn {
        executionParams?: {
            maxTokensOverride?: number;
            modelOverride?: string;
            temperatureOverride?: number;
        };
        expectedOutcomes?: AgentEvalExpectedOutcomes;
        inputPayload?: Record<string, unknown>;
        userMessage: string;
    }
    Index

    Properties

    executionParams?: {
        maxTokensOverride?: number;
        modelOverride?: string;
        temperatureOverride?: number;
    }

    Optional: Override execution params for this specific turn

    expectedOutcomes?: AgentEvalExpectedOutcomes

    Optional: Expected outcomes specific to this turn (for per-turn oracle evaluation)

    inputPayload?: Record<string, unknown>

    Input payload for this turn.

    • Turn 1: Use this payload (if provided)
    • Turn N (N>1): Automatically populated from previous turn's output
    userMessage: string

    User message for this turn