Member Junction
    Preparing search index...

    Interface ProductionSamplingCatalog

    Links, completed runs, and evaluations already stored. The job reads these and does not query itself.

    interface ProductionSamplingCatalog {
        evaluated(
            runIds: string[],
        ): Promise<{ rubricVersionId: string; runId: string }[]>;
        links(): Promise<AgentRubricLinkRow[]>;
        runs(
            filter?: { agentIds?: string[]; since?: string },
        ): Promise<AgentRunRow[]>;
        versions(): Promise<{ id: string; rubricId: string }[]>;
    }
    Index

    Methods

    evaluated links runs versions

    Methods

    • Evaluations for these run ids, one batch at a time. They point at a version. They do not store a rubric id.

      Parameters

      • runIds: string[]

      Returns Promise<{ rubricVersionId: string; runId: string }[]>

    Settings

    Member Visibility

    On This Page

    Methods