Code

Use rove for QC in the ingestor#42

Code

Open

intarga wants to merge 18 commits intotrunkmetno/lard:trunkfrom rove_integrationmetno/lard:rove_integrationCopy head branch name to clipboard

+880-323

Commits

Commits on Jan 9, 2025

• ingestion: plumbing for QC and stub qc_data implementation

  intarga

  committed
  f3aa8ad

  Copy full SHA for f3aa8ad

• db: flag tables for confident flags

  intarga

  committed
  bb39130

  Copy full SHA for bb39130

• ingestion: implement qc_data

  intarga

  committed
  8684b5b

  Copy full SHA for 8684b5b

• ingestion: refactor Data to DataChunk, pulling up shared fields in Datum

  Show description for 66ea3d7
  intarga

  committed
  66ea3d7

  Copy full SHA for 66ea3d7

• ingestion: get time_resolution for qc from type_id

  intarga

  committed
  6556b35

  Copy full SHA for 6556b35

• use real QC pipelines

  intarga

  committed
  bd9be7e

  Copy full SHA for bd9be7e

• remove obsolete test case

  intarga

  committed
  72b0b97

  Copy full SHA for 72b0b97

Commits on Jan 13, 2025

• fix typo in index on flags.confident_provenance table

  intarga

  committed
  280309e

  Copy full SHA for 280309e

• fix ambiguous column identifier in qc_data query

  intarga

  committed
  9b133bb

  Copy full SHA for 9b133bb

• show the message from ingestor when the success assertion fails

  intarga

  committed
  d72e95b

  Copy full SHA for d72e95b

Commits on Jan 14, 2025

• add partitions for flag tables

  intarga

  committed
  776408a

  Copy full SHA for 776408a

• fix integration tests

  intarga

  committed
  5ef23c0

  Copy full SHA for 5ef23c0

• fix rustfmt complaint about empty file

  intarga

  committed
  299fc7e

  Copy full SHA for 299fc7e

• fix clippy lint

  intarga

  committed
  1fe4773

  Copy full SHA for 1fe4773

Commits on Jan 15, 2025

• fix schema ordering in e2e test setup

  intarga

  committed
  8caae2b

  Copy full SHA for 8caae2b

Commits on Jan 16, 2025

• merge confident.flags into public.data

  intarga

  committed
  1762bdf

  Copy full SHA for 1762bdf

Commits on Jan 17, 2025

• modify the one current qc pipeline to match the new format

  intarga

  committed
  12ce22c

  Copy full SHA for 12ce22c

• fix path to load qc pipelines from

  Show description for 150c653
  intarga

  committed
  150c653

  Copy full SHA for 150c653