Member Junction
    Preparing search index...

    Applies only the shared cleaning rules — whitespace normalization and optional truncation — leaving the text otherwise untouched.

    This is the safe default for sources that are already plain text (transcripts, extracted PDF/DOCX text, markdown). It still earns its place in the pipeline: extracted text is routinely full of ragged spacing and stray blank lines from the extractor, and those confuse the paragraph-boundary detection that segmenters rely on.

    Hierarchy (View Summary)

    Index

    Constructors

    Accessors

    Methods

    • Collapse horizontal whitespace and runs of blank lines, while preserving the single blank line that marks a paragraph break — segmenters rely on it as a boundary signal.

      Parameters

      • content: string

      Returns string