Member Junction
    Preparing search index...

    Interface TruthHarness

    interface TruthHarness {
        Created: RunRecords;
        Provider: GraphQLDataProvider;
        RunID: string;
        User: UserInfo;
        CountNonNull(dataset: LoadedDataset, column: "TruthScore"): Promise<number>;
        CreatePipeline(spec: PipelineSpec): Promise<MJMLTrainingPipelineEntity>;
        EnsureLoaded(ref: DatasetRef): Promise<LoadedDataset>;
        GenerateStory(modelId: string): Promise<string | null>;
        Judge<TOut>(module: string, args: string[]): Promise<TOut>;
        ModelsForPipelineNamePrefix(prefix: string): Promise<CandidateModel[]>;
        Promote(
            modelId: string,
            target: PredictiveStudioModelTargetStatus,
            reason: string,
        ): Promise<PromoteAttempt>;
        ReadModel(modelId: string): Promise<CandidateModel>;
        ResetColumn(dataset: LoadedDataset, column: "TruthScore"): Promise<void>;
        RunBuilderAgent(plan: ModelingPlanSpec): Promise<AgentStepResult>;
        Score(modelId: string, req: ScoreRequest): Promise<ScoreAttempt>;
        ScoreViaRecordProcess(
            modelId: string,
            dataset: LoadedDataset,
            extraFilter: string,
        ): Promise<RecordProcessScoring>;
        Train(
            pipeline: MJMLTrainingPipelineEntity,
            opts?: { AsOf?: PredictiveStudioTrainAsOf; MaxRows?: number },
        ): Promise<TrainAttempt>;
        WriteArtifact(name: string, data: object): Promise<string>;
    }
    Index

    Properties

    Created Provider RunID User

    Methods

    CountNonNull CreatePipeline EnsureLoaded GenerateStory Judge ModelsForPipelineNamePrefix Promote ReadModel ResetColumn RunBuilderAgent Score ScoreViaRecordProcess Train WriteArtifact

    Properties

    Created: RunRecords

    The pipelines and models this harness created or observed (what RunFixtures.CleanupRun deletes).

    Provider: GraphQLDataProvider
    RunID: string
    User: UserInfo

    Methods

    • The Model Development Agent's user-facing report for one model (live AI model; G0.6's stories); null if none.

      Parameters

      • modelId: string

      Returns Promise<string | null>

    • Type Parameters

      • TOut

      Parameters

      • module: string
      • args: string[]

      Returns Promise<TOut>

    • Parameters

      • name: string
      • data: object

      Returns Promise<string>

    Settings

    Member Visibility

    On This Page

    Properties
    Methods