Skip to content

feat: Phase X X2 calibration improvement tracker schema (CIT-) - #1009

Merged
cschanhniem merged 1 commit into
mainfrom
feat/x2-calibration-improvement-tracker
Jul 10, 2026
Merged

cschanhniem merged 1 commit into
mainfrom
feat/x2-calibration-improvement-tracker

Conversation

@cschanhniem

Copy link
Copy Markdown
Collaborator

Summary

  • Adds CIT- (calibration improvement tracker) schema: aggregates MBL- batch records and computes whether hit rate is trending up
  • Trend auto-computed: improving (delta≥+0.05), stable (-0.05 to +0.05), degrading (≤-0.05), insufficient_data (<2 batches with wet-lab data)
  • Summary grade: A (improving + latest≥25%), B (improving/stable + latest≥10%), C (stable), D (degrading/low)
  • insufficient_data forces N/A summary grade
  • BatchHitRateEntry helper links batch_id, mbl_id, hit_rate, quality_grade
  • dry_lab_only=True enforced; 49 tests

Test plan

  • python3 -m pytest tests/evidence/test_calibration_improvement_tracker.py -- 49 passed

…regates MBL records; VALID_CIT_TREND_DIRECTIONS (4), MIN_BATCHES_FOR_TREND=2, IMPROVEMENT_THRESHOLD=0.05; BatchHitRateEntry helper; trend from first→latest delta; insufficient_data→N/A; 49 tests
@cschanhniem
cschanhniem merged commit 7740d25 into main Jul 10, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant