Member Junction
    Preparing search index...

    Interface RealtimeChunkVideoFrame

    One encoded video frame, as WebCodecs takes it: H.264 in Annex B form (start codes, with the SPS and PPS before each key frame), or VP8, VP9 or AV1 as raw frames. Carries no voice.

    interface RealtimeChunkVideoFrame {
        Data: ArrayBuffer;
        Height?: number;
        Idle?: boolean;
        KeyFrame: boolean;
        Kind: "chunk";
        MimeType: string;
        PresentationTimeMs: number;
        Width?: number;
    }

    Hierarchy (View Summary)

    Index

    Properties

    Data Height? Idle? KeyFrame Kind MimeType PresentationTimeMs Width?

    Properties

    Data: ArrayBuffer

    The bytes. A consumer may transfer the buffer to another thread: read what you need before handing it on.

    Height?: number

    The picture's height in pixels, when known.

    Idle?: boolean

    true when the frame is video the model streams between its answers (Vertex AI sends an avatar's face then too): it plays, but the agent is not speaking, whatever audio the frame carries, so a room's floor gate never counts it as speech. Set by a driver that can tell; absent when it can't, or when the frame is part of an answer.

    KeyFrame: boolean

    Required for a chunk: a decoder can only start at a key frame.

    Kind: "chunk"
    MimeType: string

    The format: 'video/mp4' for an fMP4 piece; for a chunk, its codec ('video/vp8', 'video/h264; codecs="avc1.42e01f"'); for an image, its type ('image/jpeg').

    PresentationTimeMs: number

    Required for a chunk: a decoder needs every chunk's time.

    Width?: number

    The picture's width in pixels, when known.

    Settings

    Member Visibility

    On This Page

    Properties