Member Junction
    Preparing search index...

    Interface RealtimeVideoFrameBase

    The fields every RealtimeVideoFrame has.

    interface RealtimeVideoFrameBase {
        Data: ArrayBuffer;
        Height?: number;
        Idle?: boolean;
        KeyFrame?: boolean;
        MimeType: string;
        PresentationTimeMs?: number;
        Width?: number;
    }

    Hierarchy (View Summary)

    Index

    Properties

    Data Height? Idle? KeyFrame? MimeType PresentationTimeMs? Width?

    Properties

    Data: ArrayBuffer

    The bytes. A consumer may transfer the buffer to another thread: read what you need before handing it on.

    Height?: number

    The picture's height in pixels, when known.

    Idle?: boolean

    true when the frame is video the model streams between its answers (Vertex AI sends an avatar's face then too): it plays, but the agent is not speaking, whatever audio the frame carries, so a room's floor gate never counts it as speech. Set by a driver that can tell; absent when it can't, or when the frame is part of an answer.

    KeyFrame?: boolean

    Whether a decoder can start here: a key frame, or an fMP4 fragment whose first video sample is one.

    MimeType: string

    The format: 'video/mp4' for an fMP4 piece; for a chunk, its codec ('video/vp8', 'video/h264; codecs="avc1.42e01f"'); for an image, its type ('image/jpeg').

    PresentationTimeMs?: number

    When the frame shows, in milliseconds on the stream's own media timeline, not wall-clock time. The voice that goes with it is on the same timeline: a player shows the frame when the voice reaches this time. A new stream (an fMP4 init segment, or a key frame whose time goes backwards) may restart it.

    Width?: number

    The picture's width in pixels, when known.

    Settings

    Member Visibility

    On This Page

    Properties