Member Junction
    Preparing search index...

    Interface SegmentationOptions

    Common knobs understood by every segmenter. Concrete segmenters extend this with their own strongly-typed options rather than accepting a loose bag.

    interface SegmentationOptions {
        MaxSegmentTokens?: number;
        MinSegmentTokens?: number;
        OverlapTokens?: number;
    }

    Hierarchy (View Summary)

    Index

    Properties

    MaxSegmentTokens? MinSegmentTokens? OverlapTokens?

    Properties

    MaxSegmentTokens?: number

    Hard ceiling on tokens per text segment. The base class splits any oversized segment via TextChunker so no segmenter can exceed it. Default: 512.

    MinSegmentTokens?: number

    Segments whose text estimates below this many tokens are merged forward into the next segment, preventing a spray of near-empty vectors. Default: 0 (off).

    OverlapTokens?: number

    Overlap tokens applied when an oversized segment must be split. Default: 10% of max.

    Settings

    Member Visibility

    On This Page

    Properties