Skip to content

CI validation of dictionary against data with the data-dict CLI #107

Description

@larnsce

Motivation

Today nothing checks that data-raw/dictionary.csv still matches the data — a renamed column, a type change, or a new variable only gets caught by eye. With data-dict.yaml (#105) and parquet exports (#106) in place, the data-dict CLI can enforce dictionary–data consistency mechanically:

  • validate-spec — dictionary conforms to the YAML schema
  • validate-meta — column names/types match the parquet files
  • validate-data — values satisfy constraints (ranges, enum values, required, assertions)

Background: dev/research-data-dict-integration.md, section "Option B".

Proposal

Acceptance criteria

  • Scaffolded workflow fails CI when dictionary and data drift apart (renamed column, out-of-range value)
  • Runs green on a pilot openwashdata package
  • No hard dependency on the CLI for washr itself (CRAN-safe)

Caveat

The spec is v0.1.0 and may change; pin the CLI version in the workflow template.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions