One oracle per criterion and one overall. The test score is the mean of the per-criterion quadratic-weighted kappas, clamped to 0..1.
One oracle per criterion and one overall. The test score is the mean of the per-criterion quadratic-weighted kappas, clamped to 0..1.