Member Junction
    Preparing search index...

    Function BuildDiscoveryEvalConfiguration

    • A cell's test Configuration, scored by the discovery-label-match oracle.

      Parameters

      • cell: {
            baseline?: "semantic-search";
            failover?: boolean;
            inputPricePer1M?: number;
            label: string;
            modelId?: string;
            outputPricePer1M?: number;
            promptName?: string;
            seed?: number;
            temperature?: number;
            vendorId?: string;
        }

        The cell.

        • Optionalbaseline?: "semantic-search"

          Runs this baseline instead of the decision. The model settings then do not apply.

        • Optionalfailover?: boolean
        • OptionalinputPricePer1M?: number

          USD per million input tokens, for the cost estimate only.

        • label: string

          Names the cell. It becomes the bracketed part of every record's name.

        • OptionalmodelId?: string
        • OptionaloutputPricePer1M?: number

          USD per million output tokens, for the cost estimate only.

        • OptionalpromptName?: string
        • Optionalseed?: number
        • Optionaltemperature?: number
        • OptionalvendorId?: string

      Returns {
          baseline?: "semantic-search" | null;
          decision: "agent-discovery";
          failover?: boolean | null;
          modelId?: string | null;
          oracles: {
              config?: Record<string, unknown>;
              type: string;
              weight?: number;
          }[];
          promptName?: string
          | null;
          seed?: number | null;
          temperature?: number | null;
          vendorId?: string | null;
      }

      • Optionalbaseline?: "semantic-search" | null

        Runs this baseline instead of the decision: no decision call is made.

      • decision: "agent-discovery"
      • Optionalfailover?: boolean | null

        Whether the runner may fail over. Defaults to false when the cell pins a model or vendor.

      • OptionalmodelId?: string | null

        Pins the MJ: AI Models row that must answer.

      • oracles: { config?: Record<string, unknown>; type: string; weight?: number }[]

        The oracles to run.

      • OptionalpromptName?: string | null

        The decision prompt. Defaults to Default Decision, the prompt production's discovery asks.

      • Optionalseed?: number | null

        Requested sampling seed. Recorded, not applied: see the driver.

      • Optionaltemperature?: number | null

        Requested sampling temperature. Recorded, not applied: see the driver.

      • OptionalvendorId?: string | null

        Pins the vendor.

    Settings

    Member Visibility