Member Junction
    Preparing search index...

    One golden case (stored in the test's InputDefinition): the record input and, per output, the accepted labels.

    interface GoldenCase {
        ExpectAbstain?: string[];
        Expected: Record<string, string[]>;
        ID: string;
        Input: Record<string, unknown>;
        LabelSource:
            | "human"
            | "model-consensus"
            | "model-adjudicated"
            | "specification";
        Required?: boolean;
    }
    Index

    Properties

    ExpectAbstain?: string[]

    Outputs whose correct answer is an abstention: withheld below the confidence floor, no answer, or an Expected label.

    Expected: Record<string, string[]>

    Per output, the accepted labels (first = primary); for an ExpectAbstain output, accepted abstain values.

    ID: string

    Stable case ID, e.g. "g01".

    Input: Record<string, unknown>

    The record fields the pipeline reads. unknown because the values are whatever column types the pipeline's entity has; the scorer never reads them, it only passes them to the pipeline and hashes them.

    LabelSource: "human" | "model-consensus" | "model-adjudicated" | "specification"

    Where the labels came from: human (an app user), model-consensus (two model labelers agreed), model-adjudicated (a third labeler decided), specification (fixed by the pipeline's written rule, not labelled).

    Required?: boolean

    A must-pass case: when any output it scores is wrong, the gate value is 0 whatever the accuracy.