Results of executing each browser action
Browser actions the controller requested
The controller's reasoning for this step
Total duration of this step in milliseconds
OptionalErrorError that occurred during this step (if applicable)
OptionalJudgeJudge verdict (if the judge was consulted this step)
Screenshot captured at the start of this step (base64 PNG)
Step number (1-indexed)
Tool calls executed during this step
URL of the page at the start of this step
Complete record of a single step in the engine's main loop. Captures everything that happened: screenshot, controller decision, actions executed, tool calls, judge verdict, and timing.
This is the primary data structure that flows through: