maiven gateway · online··
manifest · 1d ago
Sign insources
Operational tables feeding the warehouse
Every source declared in the MAIVEN project, paired with the ingest connection that loads it and the staging models that consume it.
Source tables
96
8 groups
Fresh
0
MAIVEN Transform source freshness pass
Stale
0
all caught up
Unknown
96
no freshness signal yet
gcs_mdtsource
12 tables · 12 unknown
gcs_mdtsource
12 tables · 12 unknown
Table
Freshness
Loaded by
Last loaded
Consumers
- mdt_approval_rulesgcs_mdtEnumerated routing config — escalation triggers, review paths, issuance routes, requote reasons. From 06_Approval_Rules_and_Routing_Map.md.Pending——stg_gcs__mdt_approval_rules
- mdt_contactsgcs_mdtClient contacts on an opportunity — named natural persons at the buying organisation (name/email/phone are PII).Pending——stg_gcs__mdt_contacts
- mdt_devicesgcs_mdtOne row per device under test (autoinjector, PFS, cartridge, inhaler, on-body injector, …). nickname is the join key across tests + pricing.Pending——stg_gcs__mdt_devices
- mdt_historical_matchesgcs_mdtDerived similarity edges — past jobs a new opportunity resembles (drives the HistoricalContext surface).Pending——stg_gcs__mdt_historical_matches
- mdt_opportunitiesgcs_mdtOne row per RFQ opportunity / Smithers job reference. Carries the client entity, region, study type, key dates, and the Smithers staff leads (PII). client_name + budget are confidential-commercial.Pending——stg_gcs__mdt_opportunities
- mdt_pricing_line_itemsgcs_mdtOne cost line per device per proposal. rate + amount are confidential-commercial (surfaced only via the BI-only pricing mart).Pending——stg_gcs__mdt_pricing_line_items
- mdt_proposalsgcs_mdtOne row per issued/historical proposal. Carries total_rom + contingency (confidential-commercial), lifecycle status, entity, review path, cycle time, and the Smithers staff leads (PII).Pending——stg_gcs__mdt_proposals
- mdt_rate_cardgcs_mdtSynthetic per-test rate card (docs/smithers/rate-card-spec.md) — the reference price list an external RFQ-pricing app reads via query_records('mdt_rate_card') to cost a set of requested tests. Keyed on the canonical test names from mdt_test_methods, with raw-name aliases so any test-plan name resolves. Rates are GBP integer pence (unit_rate_minor). Confidential-commercial (no PII).Pending——stg_gcs__mdt_rate_card
- mdt_rfpsgcs_mdtIncoming RFP/RFQ intake pipeline (MVD Category 02) — one row per incoming Request for Proposal awaiting a quote. Real RFPs (from the package RFQ artifacts, linked to their opportunity) + synthetic net-new prospects. Carries the intake-owning BDM (PII); client_name + budget are confidential-commercial.Pending——stg_gcs__mdt_rfps
- mdt_sme_directorygcs_mdtNamed Smithers subject-matter experts by site/role/domain (PII) — the peer-review pool + escalation ladder. From 07_SME_Directory.md.Pending——stg_gcs__mdt_sme_directory
- mdt_standardsgcs_mdtISO/ASTM/USP standards catalog (ISO 11608-1, ASTM D6653-13, ISO 7864 …), each linked to its full-text PDF blob in the mdt-standards corpus.Pending——stg_gcs__mdt_standards
- mdt_test_methodsgcs_mdtOne row per test per device — test name, standards cited, replicates, acceptance criteria, sequence position.Pending——stg_gcs__mdt_test_methods
gcs_filessource
1 table · 1 unknown
gcs_filessource
1 table · 1 unknown
Table
Freshness
Loaded by
Last loaded
Consumers
gcs_rfxsource
9 tables · 9 unknown
gcs_rfxsource
9 tables · 9 unknown
Table
Freshness
Loaded by
Last loaded
Consumers
- rfx_accountsgcs_rfxProcurement accounts — the buying organisations RFX opportunities come from. One row per account, dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_accounts.csv`.Pending——stg_gcs__rfx_accounts
- rfx_approval_rulesgcs_rfxThe approval-workflow rules that gate proposals on discount, value, margin, and legal terms — one row per rule, dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_approval_rules.csv`.Pending——stg_gcs__rfx_approval_rules
- rfx_contactsgcs_rfxBuyer-side contacts at each procurement account, dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_contacts.csv`. Carries identity PII (name, email, phone) for natural persons.Pending——stg_gcs__rfx_contacts
- rfx_opportunitiesgcs_rfxRFX opportunities — the deals we respond to. One row per RFP / RFQ / RFI, dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_opportunities.csv`.Pending——stg_gcs__rfx_opportunities
- rfx_permissionsgcs_rfxThe role-based access-control matrix for the procurement domain — one row per (role × resource × action), dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_permissions.csv`.Pending——stg_gcs__rfx_permissions
- rfx_price_bookgcs_rfxRegion- and segment-adjusted pricing entries per SKU — one row per (sku × region × segment), dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_price_book.csv`.Pending——stg_gcs__rfx_price_book
- rfx_products_servicesgcs_rfxThe catalog of products and services we quote in proposals — one row per SKU, dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_products_services.csv`.Pending——stg_gcs__rfx_products_services
- rfx_proposalsgcs_rfxProposals we submitted in response to opportunities — one row per proposal version, dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_proposals.csv`.Pending——stg_gcs__rfx_proposals
- rfx_sme_directorygcs_rfxThe directory of subject-matter experts who own opportunities and author proposals — one row per SME, dropped as CSV into `gs://${GCS_BUCKET_NAME}/rfx/rfx_sme_directory.csv`. Carries identity PII (name, email) for employees.Pending——stg_gcs__rfx_sme_directory
gcs_logisticssource
13 tables · 13 unknown
gcs_logisticssource
13 tables · 13 unknown
Table
Freshness
Loaded by
Last loaded
Consumers
- whse_approval_rulesgcs_logisticsThe approval-workflow rules that gate operations on write-off value, hazmat handling, credit notes, and SLA waivers — one row per rule, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_approval_rules.csv`. Demonstration content only — no PII.Pending——stg_gcs__whse_approval_rules
- whse_clientsgcs_logisticsThe brand tenants whose goods the 3PL stores — one row per client brand, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_clients.csv`. `client_id` is THE multi-tenant isolation dimension. Carries client-contact PII.Pending——stg_gcs__whse_clients
- whse_consigneesgcs_logisticsThe B2C delivery recipients — the primary GDPR data subject for the DSR/erasure demo, reachable from `whse_orders.consignee_id`. One row per consignee, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_consignees.csv`. Consumer PII.Pending——stg_gcs__whse_consignees
- whse_contractsgcs_logisticsThe client×site engagement carrying the SLA targets the whole operational-analytics story measures against — one row per contract, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_contracts.csv`. Every row carries a deterministic `source_uri` into `client-sla-contracts`. No PII on the structured row (the SLA contract document is PII-by-default at corpus level).Pending——stg_gcs__whse_contracts
- whse_inventorygcs_logisticsLive stock positions at SKU×site×lot grain — one row per lot, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_inventory.csv`. The spine for inventory turnover, days-of-cover, and near-expiry. Carries a denormalized `client_id` for the row policy. No PII.Pending——stg_gcs__whse_inventory
- whse_order_linesgcs_logisticsThe line grain behind pick accuracy and units picked — one row per order line, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_order_lines.csv`. The largest table by row count. No PII.Pending——stg_gcs__whse_order_lines
- whse_ordersgcs_logisticsThe outbound fulfillment spine — the largest table and the engine of OTIF/on-time/in-full. One row per order, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_orders.csv`. Carries `client_id` (the isolation key the tenant-isolation gate reads). PII indirect: `consignee_id` FK points at PII; the order row holds no direct PII.Pending——stg_gcs__whse_orders
- whse_permissionsgcs_logisticsThe role-based access-control matrix for the warehousing domain — one row per (role × resource × action), dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_permissions.csv`. Demonstration content only — the enforced boundary is the persona grants + row/column policies (§5), not these rows. No PII.Pending——stg_gcs__whse_permissions
- whse_productsgcs_logisticsThe client-owned SKU catalog — one row per SKU, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_products.csv`. Drives temperature-class and hazard-class distributions. Hazardous SKUs (`hazard_class != 'none'`) carry a `source_uri` into `safety-data-sheets`. No PII.Pending——stg_gcs__whse_products
- whse_returnsgcs_logisticsReturns disposition and cycle time — one row per return, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_returns.csv`. Carries a denormalized `client_id` for the row policy. Feeds metric_returns_rate. No PII.Pending——stg_gcs__whse_returns
- whse_sitesgcs_logisticsThe physical warehouse network across countries/regions — one row per site, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_sites.csv`. No client key: a multi-user site stores many clients' goods. No PII.Pending——stg_gcs__whse_sites
- whse_staffgcs_logisticsThe warehouse workforce — one row per staff member, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_staff.csv`. `units_per_labor_hr` feeds site productivity in mart_site_performance. Employee PII.Pending——stg_gcs__whse_staff
- whse_temperature_eventsgcs_logisticsCold-chain excursion records against chilled/frozen lots — one row per excursion, dropped as CSV into `gs://${GCS_BUCKET_NAME}/logistics/whse_temperature_events.csv`. Staging-only (no mart/metric/row-detail surface in P0/P1, INC-16). No PII, but a retention anchor: lawful_basis legal_obligation, GDP ~5yr.Pending——stg_gcs__whse_temperature_events
postgres_ecommercesource
20 tables · 20 unknown
postgres_ecommercesource
20 tables · 20 unknown
Table
Freshness
Loaded by
Last loaded
Consumers
- addressespostgres_ecommerceCustomer shipping/billing addresses with a validity window.Pending——stg_postgres__addresses
- agentspostgres_ecommerceSupport agents — humans handling tickets.Pending——stg_postgres__agents
- consent_eventspostgres_ecommerceAppend-only consent ledger — one row per (customer × purpose) state change. Drives lawful-basis enforcement: queries that touch a customer must check `mart_consent_current` for an active grant on the relevant purpose. Withdrawals create a new row with event_type='withdrawn'.Pending——stg_postgres__consent_events
- customerspostgres_ecommerceOne row per customer in the operational DB.Pending——stg_postgres__customers
- eventspostgres_ecommerceCustomer-facing web events (page views, cart, checkout). Not currently consumed by staging models — kept around for future engagement-funnel marts.Pending——stg_postgres__events
- marketing_campaignspostgres_ecommerceOutbound campaign catalog. Optional FK to a promotion.Pending——stg_postgres__marketing_campaigns
- marketing_sendspostgres_ecommercePer-customer touchpoint with engagement timestamps. Grain (campaign, customer) is UNIQUE on the source. Sends are gated upstream on `consent_events.purpose='marketing'` — mid-window withdrawals are NOT reflected here.Pending——stg_postgres__marketing_sends
- order_itemspostgres_ecommerceLine items per order. Joins to `orders.order_id` and `products.product_id`.Pending——stg_postgres__order_items
- order_promotionspostgres_ecommerceOrders ↔ promotions junction with the captured `discount_amount`. UNIQUE (order_id, promotion_id).Pending——stg_postgres__order_promotions
- orderspostgres_ecommerceOne row per customer order.Pending——stg_postgres__orders
- payment_methodspostgres_ecommerceTokenised payment instruments per customer. Raw PAN never stored.Pending——stg_postgres__payment_methods
- paymentspostgres_ecommerceOne row per payment transaction. Auth → capture → optional refund/void.Pending——stg_postgres__payments
- product_inventory_snapshotspostgres_ecommerceDaily inventory positions per (product, warehouse). UNIQUE on the source.Pending——stg_postgres__product_inventory_snapshots
- productspostgres_ecommerceProduct catalog.Pending——stg_postgres__products
- promotionspostgres_ecommerceDiscount catalog. Standalone; joined to orders via `order_promotions`.Pending——stg_postgres__promotions
- returnspostgres_ecommerceOne row per product return / RMA. Keys to orders, order_items, products, and customers — the operational record of what was sent back, why, and how much was refunded. Feeds return-rate and refund-leakage analytics by product category.Pending——stg_postgres__returns
- shipmentspostgres_ecommerceOrder fulfillment per shipment. One order may have multiple.Pending——stg_postgres__shipments
- subscriptionspostgres_ecommerceRecurring plans per (customer, product). `monthly_amount` already normalised on the source.Pending——stg_postgres__subscriptions
- support_ticketspostgres_ecommerceOne row per customer support ticket. Joins to customers and agents.Pending——stg_postgres__support_tickets
- ticket_eventspostgres_ecommerceEvent log per ticket — created/assigned/comment/status_change/csat_submitted/closed.Pending——stg_postgres__ticket_events
postgres_financesource
38 tables · 38 unknown
postgres_financesource
38 tables · 38 unknown
Table
Freshness
Loaded by
Last loaded
Consumers
- ap_payment_applicationspostgres_financeBridge applying AP payments to the vendor bills they settle.Pending——stg_postgres__ap_payment_applications
- ap_paymentspostgres_financeAP payments (cash out). Statutory financial record keyed to a vendor.Pending——stg_postgres__ap_payments
- approvalspostgres_financePolymorphic approval steps over finance objects. `object_id` is a soft FK keyed by object_type.Pending——stg_postgres__approvals
- ar_receipt_applicationspostgres_financeBridge applying AR receipts to the customer invoices they settle.Pending——stg_postgres__ar_receipt_applications
- ar_receiptspostgres_financeAR receipts (cash in). Statutory record keyed to the ecommerce `customer` subject.Pending——stg_postgres__ar_receipts
- audit_logpostgres_financeAppend-only audit log over finance objects. old_value/new_value are free-text PII (retain_aggregate).Pending——stg_postgres__audit_log
- bank_accountspostgres_financeBank-account dimension. Each maps to a GL cash account and optionally a legal entity.Pending——stg_postgres__bank_accounts
- bank_transactionspostgres_financeBank-statement transactions. `counterparty_name` is incidental financial PII.Pending——stg_postgres__bank_transactions
- bill_linespostgres_financeVendor-bill line items (AP). `description` is incidental free-text PII.Pending——stg_postgres__bill_lines
- budget_linespostgres_financeBudget amounts per (budget, gl_account, cost_center, period).Pending——stg_postgres__budget_lines
- budgetspostgres_financeBudget headers (FP&A). Statutory-adjacent planning record kept 7 years.Pending——stg_postgres__budgets
- chat_channelspostgres_financeChat-channel metadata (Slack/Teams). `topic` is free-text PII. Comms — legitimate_interest + 365d.Pending——stg_postgres__chat_channels
- chat_messagespostgres_financeChat-message metadata + body. `body_text` is free-text PII. Comms — legitimate_interest + 365d.Pending——stg_postgres__chat_messages
- communication_linkspostgres_financePolymorphic bridge "show me all comms about entity X". Both sides are soft FKs.Pending——stg_postgres__communication_links
- cost_centerspostgres_financeCost-center org dimension. Self-referencing parent hierarchy; optional owner employee.Pending——stg_postgres__cost_centers
- customer_invoicespostgres_financeCustomer invoices (AR). Statutory record keyed to the existing ecommerce `customer` subject.Pending——stg_postgres__customer_invoices
- depreciation_schedulepostgres_financePer-period depreciation schedule per fixed asset. Source of recurring depreciation JEs.Pending——stg_postgres__depreciation_schedule
- email_message_participantspostgres_financeEmail participants (to/cc/bcc). participant_email + participant_display_name are contact PII.Pending——stg_postgres__email_message_participants
- email_messagespostgres_financeEmail-message metadata + inline body. subject/body_text/sender_email/sender_display_name are PII.Pending——stg_postgres__email_messages
- email_threadspostgres_financeEmail-thread metadata. `subject` is free-text PII. Comms — legitimate_interest + 365d.Pending——stg_postgres__email_threads
- expense_report_linespostgres_financeExpense-report line items. `merchant_name` + `description` are behavioral PII.Pending——stg_postgres__expense_report_lines
- expense_reportspostgres_financeExpense-report headers. Keyed to the submitting `employee`. `report_title` is behavioral PII.Pending——stg_postgres__expense_reports
- finance_employeespostgres_financeFinance employee identity table — the `employee` data subject. Carries identity / contact / financial PII.Pending——stg_postgres__finance_employees
- finance_notespostgres_financeFinance notes. `title` + `body_text` are free-text PII. Comms — legitimate_interest + 365d.Pending——stg_postgres__finance_notes
- fixed_assetspostgres_financeFixed-asset register. Statutory financial record.Pending——stg_postgres__fixed_assets
- forecast_linespostgres_financeForecast amounts per (forecast, gl_account, cost_center, period).Pending——stg_postgres__forecast_lines
- forecastspostgres_financeForecast headers (FP&A). Planning record.Pending——stg_postgres__forecasts
- fx_ratespostgres_financeFX rate table — one row per (from, to, date, type). Translates txn currency to functional USD.Pending——stg_postgres__fx_rates
- gl_accountspostgres_financeChart of accounts. `is_control_account` flags the AR/AP control accounts subledgers tie to.Pending——stg_postgres__gl_accounts
- gl_journal_entriespostgres_financeGL journal-entry headers. Statutory financial record.Pending——stg_postgres__gl_journal_entries
- gl_journal_linespostgres_financeGL journal lines (double-entry). Exactly one of debit/credit is non-zero per line. Statutory record.Pending——stg_postgres__gl_journal_lines
- invoice_linespostgres_financeCustomer-invoice line items (AR). Optionally links to an ecommerce product.Pending——stg_postgres__invoice_lines
- legal_entitiespostgres_financeReporting legal entities (e.g. US-INC, EU-GMBH). Entity dimension on GL / periods / cost centers / planning.Pending——stg_postgres__legal_entities
- reconciliation_itemspostgres_financeReconciliation match lines tying bank transactions and/or GL lines to a reconciliation.Pending——stg_postgres__reconciliation_items
- reconciliationspostgres_financeBank reconciliations per (bank_account, period). Statutory financial record.Pending——stg_postgres__reconciliations
- recurring_journal_templatespostgres_financeRecurring-journal templates (accrual / deferral / prepaid / recurring).Pending——stg_postgres__recurring_journal_templates
- vendor_billspostgres_financeVendor bills (AP). Statutory financial record keyed to a vendor.Pending——stg_postgres__vendor_bills
- vendorspostgres_financeVendor master — the `vendor` data subject. Carries identity / contact / financial / location PII.Pending——stg_postgres__vendors
finance_periodssource
1 table · 1 unknown
finance_periodssource
1 table · 1 unknown
unstructured_filessource
2 tables · 2 unknown
unstructured_filessource
2 tables · 2 unknown
Table
Freshness
Loaded by
Last loaded
Consumers
- document_chunksunstructured_filesOne row per paragraph-shaped chunk derived from the DoclingDocument hierarchy by docker/docling-extractor. Default chunking is ~512 tokens with soft section-boundary flushes.Pending——stg_unstructured__document_chunks
- documentsunstructured_filesOne row per source document, written by docker/docling-extractor. Carries extracted text + extractor metadata + Presidio entity counts (counts only, never values).Pending——stg_unstructured__documents