Member Junction
    Preparing search index...

    Interface SuiteRunOptions

    Options for running a test suite

    interface SuiteRunOptions {
        agentVersion?: string;
        configOverride?: Record<string, unknown>;
        delayBetweenTests?: number;
        dryRun?: boolean;
        environment?: string;
        failFast?: boolean;
        gitCommit?: string;
        logCallback?: (message: TestLogMessage) => void;
        maxParallel?: number;
        parallel?: boolean;
        progressCallback?: (progress: TestProgress) => void;
        repeatCountOverride?: number;
        selectedTestIds?: string[];
        sequence?: number[];
        sequenceEnd?: number;
        sequenceStart?: number;
        tags?: string;
        variables?: TestRunVariables;
        verbose?: boolean;
    }

    Hierarchy (View Summary)

    Index

    Properties

    agentVersion? configOverride? delayBetweenTests? dryRun? environment? failFast? gitCommit? logCallback? maxParallel? parallel? progressCallback? repeatCountOverride? selectedTestIds? sequence? sequenceEnd? sequenceStart? tags? variables? verbose?

    Properties

    agentVersion?: string

    Agent/system version being tested

    configOverride?: Record<string, unknown>

    Override test configuration

    delayBetweenTests?: number

    Delay in milliseconds between test executions. Useful for avoiding rate limits (e.g., Auth0 brute-force protection) when tests perform repeated logins from the same IP.

    dryRun?: boolean

    Validate configuration without executing

    environment?: string

    Environment context (dev, staging, prod)

    failFast?: boolean

    Stop on first failure

    gitCommit?: string

    Git commit SHA for versioning

    logCallback?: (message: TestLogMessage) => void

    Log callback for streaming execution details to the test run log

    maxParallel?: number

    Maximum parallel tests (if parallel=true)

    parallel?: boolean

    Run tests in parallel

    progressCallback?: (progress: TestProgress) => void

    Progress callback for real-time updates

    repeatCountOverride?: number

    Override the test's RepeatCount field at runtime. Useful for flaky-test detection: forces every test in the run to execute N times so the suite runner can compute score variance. If undefined, the test's own RepeatCount is used.

    selectedTestIds?: string[]

    Run only specific tests by their IDs. If provided, only tests with matching IDs will be executed.

    sequence?: number[]

    Run only specific sequence numbers (e.g., [1, 3, 5] runs tests at those positions)

    sequenceEnd?: number

    Stop execution at this sequence number (inclusive). Tests with sequence numbers greater than this value will be skipped.

    sequenceStart?: number

    Start execution from this sequence number (inclusive). Tests with sequence numbers less than this value will be skipped.

    tags?: string

    Tags to apply to the test run (JSON string array)

    variables?: TestRunVariables

    Variable values to use for this run. These values take highest priority in the resolution order: run > suite > test > type

    verbose?: boolean

    Verbose logging

    Settings

    Member Visibility

    On This Page

    Properties