stg_unstructured__document_chunks

staging view 1 PII columns

Chunks, typed — the embedding worker's input.

Definition

Cleaned mirror of `raw_unstructured.document_chunks`. Coerces IDs to UUID/UInt32 and validates the FK to `stg_unstructured__documents`. The mart adds the embedding column and the HNSW index on top.

8 of 8

Column

Description

Tests · PII

document_id

FK to stg_unstructured__documents.

document +4 PII2 tests

chunk_seq

0-based position. Unique within a document.

1 test

chunk_text

Paragraph-shaped chunk text. Soft cap ~512 tokens.

1 testPII

section

Heading path resolved for this chunk. Nullable.

page_start

First page this chunk's content appears on.

page_end

Last page this chunk's content appears on.

source_file_url

Airbyte-supplied `_ab_source_file_url`.

airbyte_extracted_at

When Airbyte extracted this row from GCS.