Member Junction
    Preparing search index...

    Metric direction lookups.

    Index

    Constructors

    Methods

    • Whether a metric is lower-is-better (an error/loss metric). Case-insensitive and whitespace-tolerant.

      Parameters

      • metricKey: string

        the metric name (e.g. brier, RMSE, poisson-deviance, auc)

      Returns boolean

      true for every lower-is-better key in METRIC_DIRECTION and the legacy spellings, else false

    • A raw score oriented so that higher is always better: a lower-is-better metric negated, a closer-to-one metric minus its distance from one (|1 − value|, how a calibration slope is ranked), a higher-is-better metric as stored; null for a metric whose direction is not known (it must not be ranked). OnMetricScale is its inverse.

      Parameters

      • raw: number

        the score as stored

      • metricKey: string

        the metric it is on

      Returns number | null

    • A normalized score (higher is better: a lower-is-better metric negated, a closer-to-one metric minus its distance from one) back on its metric's own scale: a loss reads as the loss, a closer-to-one score as its distance from 1 (label it with MetricScaleLabel), a higher-is-better or unknown metric as stored. The one inverse of the leaderboard normalization; every display of a normalized score goes through it.

      Parameters

      • normalized: number

        the normalized score

      • metricKey: string

        the metric the score was read from

      Returns number