Interface DecisionEvaluation

Per-component outcome, so §6.1's metrics fall out of the stored details.

interface DecisionEvaluation {
    actionAccuracy: number | null;
    decisionKindMatch: boolean;
    forbiddenViolations: string[];
    messages: string[];
    paramFidelity: number | null;
    paramResults: ParamMatchResult[];
    passed: boolean;
    score: number;
}

Properties

actionAccuracy: number | null

Metric 4 — right action name(s). null when the case expects no action.

decisionKindMatch: boolean

Metric 3 — did the agent decide the right kind of thing?

forbiddenViolations: string[]

Forbidden names the agent invoked anyway. Non-empty is always a failure.

messages: string[]

Human-readable reasons, in the order they were detected.

paramFidelity: number | null

Metric 5 — share of parameter matchers that passed. null when the case declares none.

Individual matcher outcomes, for reporting which parameter failed and why.

passed: boolean

Overall pass — every applicable component clean.

score: number

Mean of the APPLICABLE components. See the note in evaluateDecision.