Member Junction
    Preparing search index...

    Function BuildDecisionEvalConfiguration

    • A cell's test Configuration. The decision-label-match oracle scores the continues Likelihood against the label at 0.5.

      Parameters

      • cell: {
            failover?: boolean;
            inputPricePer1M?: number;
            label: string;
            modelId?: string;
            outputPricePer1M?: number;
            promptName?: string;
            seed?: number;
            stateLayout: "production" | "structured";
            temperature?: number;
            vendorId?: string;
        }

        The cell.

        • Optionalfailover?: boolean
        • OptionalinputPricePer1M?: number

          USD per million input tokens, for the cost estimate only.

        • label: string

          Names the cell. It becomes the bracketed part of every record's name.

        • OptionalmodelId?: string
        • OptionaloutputPricePer1M?: number

          USD per million output tokens, for the cost estimate only.

        • OptionalpromptName?: string
        • Optionalseed?: number
        • stateLayout: "production" | "structured"
        • Optionaltemperature?: number
        • OptionalvendorId?: string

      Returns {
          decision: "conversation-routing";
          failover?: boolean | null;
          modelId?: string | null;
          oracles: {
              config?: Record<string, unknown>;
              type: string;
              weight?: number;
          }[];
          promptName?: string
          | null;
          seed?: number | null;
          stateLayout: "production" | "structured";
          temperature?: number | null;
          vendorId?: string | null;
      }

      • decision: "conversation-routing"

        Which decision builder. A discovery test has its own schema (DiscoveryEvalConfigSchema).

      • Optionalfailover?: boolean | null

        Whether the runner may fail over. Defaults to false when the cell pins a model or vendor.

      • OptionalmodelId?: string | null

        Pins the MJ: AI Models row that must answer.

      • oracles: { config?: Record<string, unknown>; type: string; weight?: number }[]

        The oracles to run.

      • OptionalpromptName?: string | null

        The decision prompt. Defaults to DEFAULT_DECISION_PROMPT_NAME.

      • Optionalseed?: number | null

        Requested sampling seed. Recorded; see the driver for whether it reaches the model.

      • stateLayout: "production" | "structured"

        production sends BuildRoutingState; structured sends BuildRoutingStateStructured.

      • Optionaltemperature?: number | null

        Requested sampling temperature. Recorded; see the driver for whether it reaches the model.

      • OptionalvendorId?: string | null

        Pins the vendor.

    Settings

    Member Visibility