Skip to content

Commit 61d2fa8

Browse files
cschanhniemOpenCode
andauthored
chore: mark S5 complete in NEXT_100_PR_MAP (#975); add Phase T (batch traceability + cross-batch audit, T1-T5) (#976)
Co-authored-by: OpenCode <opencode@example.com>
1 parent 3f120c6 commit 61d2fa8

1 file changed

Lines changed: 11 additions & 1 deletion

File tree

‎docs/research/NEXT_100_PR_MAP.md‎

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -234,4 +234,14 @@ Make it possible for an external reviewer to understand, in one artifact, why sp
234234
| S2 | Add selection transparency ledger schema (STL-) (complete). — src/openamp_foundry/evidence/selection_transparency_ledger.py: STL- 16-field schema + ArtifactReference helper; VALID_SELECTION_BASES (8), VALID_SELECTION_OUTCOME_TYPES (7), VALID_LEDGER_COMPLETENESS_GRADES (4); REQUIRED (BSP/SEG/SRG); not_specified blocked; complete grade requires all required; build() auto-computes completeness; dry_lab_only=True; 48 tests. BASELINE: 9278→9341. PR #968. | Per-candidate-family ledger of every evidence artifact that influenced selection; makes selection_basis auditable and traceable. | C |
235235
| S3 | Add evidence completeness checker schema (ECC-) (complete). — src/openamp_foundry/evidence/evidence_completeness_checker.py: ECC- 17-field schema + ArtifactPresenceRecord helper; EXPECTED_ARTIFACT_TYPES (10: BSP/WHR/PCU/HCR/PQG/CFC/FNR/ATR/SRG/PEB), VALID_COMPLETENESS_GRADES (5: A-D/N/A); grade A=all present→ready_for_review; grade B=all dry+≥2 wet→ready_for_review; grade C=all dry,wet incomplete→dry_lab_review_only; grade D=dry missing→not_ready; build() auto-computes from present_artifact_ids dict; dry_lab_only=True; 63 tests. BASELINE: 9341→9404. PR #971. | Lists all expected artifact types (BSP/WHR/PCU/HCR/PQG/CFC/FNR/ATR/SRG/PEB) and which are present/absent for a candidate family; completeness_grade (A–D); closes "what's still needed for review?" question. | C |
236236
| S4 | Add pipeline run stability report schema (RSR-) (complete). — src/openamp_foundry/evidence/pipeline_run_stability_report.py: RSR- schema; PipelineRunStabilityReport (18 fields) + RunRankRecord helper; VALID_STABILITY_VERDICTS (4: stable/borderline/unstable/single_run), VALID_COMPARISON_METHODS (5); DEFAULT_STABILITY_THRESHOLD=2.0; stable=rank_std<threshold; borderline=threshold to 2x; unstable≥2x; single_run blocked; build() auto-computes from run_records list; dry_lab_only=True; 63 tests. BASELINE: 9404→9467. PR #973. | Compares outputs across N pipeline runs; flags candidate families whose ranking is unstable across runs; prevents overconfident selection of borderline candidates. | C |
237-
| S5 | Add prediction quality trend report schema (PQT-). | Tracks cumulative prediction quality across all confirmed WHR results; rolling precision/accuracy trend; degradation alerts; closes Phase S. | C |
237+
| S5 | Add prediction quality trend report schema (PQT-) (complete). — src/openamp_foundry/evidence/prediction_quality_trend_report.py: PQT- schema; PredictionQualityTrendReport (16 fields) + WHROutcomeRecord helper; VALID_TREND_VERDICTS (4: improving/stable/degrading/insufficient_data); DEFAULT_ROLLING_WINDOW=5, DEFAULT_ALERT_THRESHOLD=0.1; degrading triggers degradation_alert; Pearson score_hit_correlation; build() auto-computes rolling precision, trend, alert; dry_lab_only=True; 72 tests. BASELINE: 9467→9530. PR #975. Closes Phase S. | Tracks cumulative prediction quality across all confirmed WHR results; rolling precision/accuracy trend; degradation alerts; closes Phase S. | C |
238+
239+
## Phase T: Batch traceability and cross-batch audit (T1–T5)
240+
241+
| ID | Task | Why it matters | Priority |
242+
|----|------|----------------|----------|
243+
| T1 | Add batch traceability index schema (BTI-). | Per-batch index linking every candidate family in the batch to its evidence artifacts (BSP/SEG/ECC/STL/RSR/PQT); required_artifact_ids computed; completeness_grade (complete/partial/empty); enables cross-batch audit. | C |
244+
| T2 | Add cross-batch audit summary schema (CBA2-). | Aggregates BTI records across all batches; counts families per grade; flags batches with low completeness; required for multi-batch meta-analysis. | C |
245+
| T3 | Add batch evidence gap report schema (BEG-). | Per-batch listing of which artifact types are missing across all families; prioritized gap list; enables targeted evidence collection. | C |
246+
| T4 | Add selection audit trail schema (SAT-). | Immutable ordered log of every selection/rejection decision with evidence_artifact_ids and rationale; enables full auditability from nomination to wet-lab shortlist. | C |
247+
| T5 | Add pipeline completeness certificate schema (PCC-). | Top-level certificate asserting that all required evidence schemas are present for a given pipeline run; completeness_grade (A–D); closes Phase T. | C |

0 commit comments

Comments
 (0)