Class MJProgressComputerUseEngine

The MJ-aware goal engine bound in production. Extends MJComputerUseEngine (prompt-runner routing, vision-model auto-selection, credential resolution, media persistence) and satisfies the ComputerUseGoalRun seam:

SetBrowserAdapter / Stop are inherited from the base computer-use engine.
OnProgress + ContextUser are set by the CDP session before Run.
Run adapts the transport-neutral base params into MJRunComputerUseParams (injecting the acting user) so the MJ engine can run its prompts.
onStepComplete chains the MJ media-persistence behavior, then forwards a model-safe progress note.

Hierarchy (View Summary)

MJComputerUseEngine
- MJProgressComputerUseEngine

Implements

ComputerUseGoalRun

Index

Constructors

constructor

new MJProgressComputerUseEngine(): MJProgressComputerUseEngine
Returns MJProgressComputerUseEngine
Inherited from MJComputerUseEngine.constructor
- Defined in packages/AI/MJComputerUse/dist/engine/MJComputerUseEngine.d.ts:66

Properties

`Optional`AgentRunID

AgentRunID?: string

Parent agent-run id the CDP session sets before Run (links the goal's prompt runs to it).

`Optional`AgentRunStepID

AgentRunStepID?: string

Parent agent-run-step id the CDP session sets before Run (nests child prompt steps under it).

`Protected`authHandler

authHandler: AuthHandler

`Protected`browserAdapter

browserAdapter: BaseBrowserAdapter

`Protected`cancelled

cancelled: boolean

Whether Stop() has been called — checked at the top of each step

`Optional`ContextUser

ContextUser?: UserInfo

The MJ user the goal run executes as; the CDP session sets it from the session's context user.

`Protected`judge

judge: BaseJudge

`Protected`navigationGuard

navigationGuard: NavigationGuard

`Optional`OnProgress

OnProgress?: (progress: ComputerUseGoalProgress) => void

Per-step progress hook the CDP session sets before Run (drives live narration).

`Protected`toolProvider

toolProvider: ToolProvider

Accessors

Provider

get Provider(): IMetadataProvider
Optional metadata provider override. Callers should set instance.Provider = providerToUse before invoking Run() in multi-provider contexts. Falls back to the global default provider when unset.

Returns IMetadataProvider
Inherited from MJComputerUseEngine.Provider
- Defined in packages/AI/MJComputerUse/dist/engine/MJComputerUseEngine.d.ts:61
set Provider(value: IMetadataProvider): void
Parameters
- value: IMetadataProvider
Returns void
Inherited from MJComputerUseEngine.Provider
- Defined in packages/AI/MJComputerUse/dist/engine/MJComputerUseEngine.d.ts:62

Methods

`Protected`executeControllerPrompt

executeControllerPrompt(
request: ControllerPromptRequest,
): Promise<ControllerPromptResponse>
Route controller prompt through MJ AIPromptRunner.

If a ControllerPromptRef was resolved to an entity, uses AIPromptRunner for full MJ integration (template rendering, model selection, prompt run logging, token tracking). Otherwise falls back to the base implementation (direct LLM call).
Parameters
- request: ControllerPromptRequest
Returns Promise<ControllerPromptResponse>
Inherited from MJComputerUseEngine.executeControllerPrompt
- Defined in packages/AI/MJComputerUse/dist/engine/MJComputerUseEngine.d.ts:86

`Protected`executeJudgePrompt

executeJudgePrompt(request: JudgePromptRequest): Promise<JudgePromptResponse>
Route judge prompt through MJ AIPromptRunner.

If a JudgePromptRef was resolved to an entity, uses AIPromptRunner. Otherwise falls back to the base implementation.
Parameters
- request: JudgePromptRequest
Returns Promise<JudgePromptResponse>
Inherited from MJComputerUseEngine.executeJudgePrompt
- Defined in packages/AI/MJComputerUse/dist/engine/MJComputerUseEngine.d.ts:93

`Protected`log

log(message: string): void
Parameters
- message: string
Returns void
Inherited from MJComputerUseEngine.log
- Defined in packages/AI/ComputerUse/dist/engine/ComputerUseEngine.d.ts:314

`Protected`logError

logError(message: string, error?: unknown): void
Parameters
- message: string
- Optionalerror: unknown
Returns void
Inherited from MJComputerUseEngine.logError
- Defined in packages/AI/ComputerUse/dist/engine/ComputerUseEngine.d.ts:315

`Protected`onRunComplete

onRunComplete(result: ComputerUseResult): void
Hook for run completion. Currently logs completion status. Can be extended to update agent run records or trigger post-run workflows.
Parameters
- result: ComputerUseResult
Returns void
Inherited from MJComputerUseEngine.onRunComplete
- Defined in packages/AI/MJComputerUse/dist/engine/MJComputerUseEngine.d.ts:107

`Protected`onStepComplete

onStepComplete(step: StepRecord, params: MJRunComputerUseParams): void
Persist step screenshot as AIPromptRunMedia entity.

Links the screenshot to the most recent prompt run (from the controller call in this step). Fire-and-forget — media persistence errors are logged but don't fail the run.
Parameters
- step: StepRecord
- params: MJRunComputerUseParams
Returns void
Overrides MJComputerUseEngine.onStepComplete
- Defined in packages/MJServer/src/agentSessions/remoteBrowserGoalEngine.ts:81

Run

Run(params: RunComputerUseParams): Promise<ComputerUseResult>
Adapts the transport-neutral base params into MJRunComputerUseParams (carrying the acting user
- the parent run/step linkage) and delegates to the MJ engine, which auto-selects a vision-capable controller model from MJ metadata and nests a child step per prompt when the linkage is present.
Parameters
- params: RunComputerUseParams
  The base computer-use params the CDP session built (goal + step cap + start url).
Returns Promise<ComputerUseResult>
The computer-use run result.
Implementation of ComputerUseGoalRun.Run
Overrides MJComputerUseEngine.Run
- Defined in packages/MJServer/src/agentSessions/remoteBrowserGoalEngine.ts:77

SetBrowserAdapter

SetBrowserAdapter(adapter: BaseBrowserAdapter): void
Inject a pre-created browser adapter for shared session support. When set, the engine skips Launch()/Close() — the caller owns the lifecycle. Used by parallel test execution to share browser contexts across tests.
Parameters
- adapter: BaseBrowserAdapter
Returns void
Implementation of ComputerUseGoalRun.SetBrowserAdapter
Inherited from MJComputerUseEngine.SetBrowserAdapter
- Defined in packages/AI/ComputerUse/dist/engine/ComputerUseEngine.d.ts:58

Stop

Stop(): void
Request cancellation of a running run. The engine checks this flag at the top of each step. Cancellation is cooperative — the current step will finish.

Returns void
Implementation of ComputerUseGoalRun.Stop
Inherited from MJComputerUseEngine.Stop
- Defined in packages/AI/ComputerUse/dist/engine/ComputerUseEngine.d.ts:64

Class MJProgressComputerUseEngine

Hierarchy (View Summary)

Implements

Index

Constructors

Properties

Accessors

Methods

Constructors

constructor

Returns MJProgressComputerUseEngine

Properties

OptionalAgentRunID

OptionalAgentRunStepID

ProtectedauthHandler

ProtectedbrowserAdapter

Protectedcancelled

OptionalContextUser

Protectedjudge

ProtectednavigationGuard

OptionalOnProgress

ProtectedtoolProvider

Accessors

Provider

Returns IMetadataProvider

Parameters

Returns void

Methods

ProtectedexecuteControllerPrompt

Parameters

Returns Promise<ControllerPromptResponse>

ProtectedexecuteJudgePrompt

Parameters

Returns Promise<JudgePromptResponse>

Protectedlog

Parameters

Returns void

ProtectedlogError

Parameters

Returns void

ProtectedonRunComplete

Parameters

Returns void

ProtectedonStepComplete

Parameters

Returns void

Run

Parameters

Returns Promise<ComputerUseResult>

SetBrowserAdapter

Parameters

Returns void

Stop

Returns void

Settings

On This Page

`Optional`AgentRunID

`Optional`AgentRunStepID

`Protected`authHandler

`Protected`browserAdapter

`Protected`cancelled

`Optional`ContextUser

`Protected`judge

`Protected`navigationGuard

`Optional`OnProgress

`Protected`toolProvider

`Protected`executeControllerPrompt

`Protected`executeJudgePrompt

`Protected`log

`Protected`logError

`Protected`onRunComplete

`Protected`onStepComplete