Member Junction
    Preparing search index...
    interface CriterionAgreement {
        bias: number;
        criterionId: string;
        exactAgreement: number;
        meanAbsoluteError: number;
        sampleSize: number;
        weightedKappa: number | null;
    }
    Index

    Properties

    bias: number

    Mean of the AI score minus the human score.

    criterionId: string
    exactAgreement: number
    meanAbsoluteError: number
    sampleSize: number
    weightedKappa: number | null

    Null when every pair sits in one category, so kappa is undefined.