You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 61d2fa8
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: docs/research/NEXT_100_PR_MAP.md
+11-1Lines changed: 11 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -234,4 +234,14 @@ Make it possible for an external reviewer to understand, in one artifact, why sp
234
234
| S2 | Add selection transparency ledger schema (STL-) (complete). — src/openamp_foundry/evidence/selection_transparency_ledger.py: STL- 16-field schema + ArtifactReference helper; VALID_SELECTION_BASES (8), VALID_SELECTION_OUTCOME_TYPES (7), VALID_LEDGER_COMPLETENESS_GRADES (4); REQUIRED (BSP/SEG/SRG); not_specified blocked; complete grade requires all required; build() auto-computes completeness; dry_lab_only=True; 48 tests. BASELINE: 9278→9341. PR #968. | Per-candidate-family ledger of every evidence artifact that influenced selection; makes selection_basis auditable and traceable. | C |
235
235
| S3 | Add evidence completeness checker schema (ECC-) (complete). — src/openamp_foundry/evidence/evidence_completeness_checker.py: ECC- 17-field schema + ArtifactPresenceRecord helper; EXPECTED_ARTIFACT_TYPES (10: BSP/WHR/PCU/HCR/PQG/CFC/FNR/ATR/SRG/PEB), VALID_COMPLETENESS_GRADES (5: A-D/N/A); grade A=all present→ready_for_review; grade B=all dry+≥2 wet→ready_for_review; grade C=all dry,wet incomplete→dry_lab_review_only; grade D=dry missing→not_ready; build() auto-computes from present_artifact_ids dict; dry_lab_only=True; 63 tests. BASELINE: 9341→9404. PR #971. | Lists all expected artifact types (BSP/WHR/PCU/HCR/PQG/CFC/FNR/ATR/SRG/PEB) and which are present/absent for a candidate family; completeness_grade (A–D); closes "what's still needed for review?" question. | C |
236
236
| S4 | Add pipeline run stability report schema (RSR-) (complete). — src/openamp_foundry/evidence/pipeline_run_stability_report.py: RSR- schema; PipelineRunStabilityReport (18 fields) + RunRankRecord helper; VALID_STABILITY_VERDICTS (4: stable/borderline/unstable/single_run), VALID_COMPARISON_METHODS (5); DEFAULT_STABILITY_THRESHOLD=2.0; stable=rank_std<threshold; borderline=threshold to 2x; unstable≥2x; single_run blocked; build() auto-computes from run_records list; dry_lab_only=True; 63 tests. BASELINE: 9404→9467. PR #973. | Compares outputs across N pipeline runs; flags candidate families whose ranking is unstable across runs; prevents overconfident selection of borderline candidates. | C |
237
-
| S5 | Add prediction quality trend report schema (PQT-). | Tracks cumulative prediction quality across all confirmed WHR results; rolling precision/accuracy trend; degradation alerts; closes Phase S. | C |
237
+
| S5 | Add prediction quality trend report schema (PQT-) (complete). — src/openamp_foundry/evidence/prediction_quality_trend_report.py: PQT- schema; PredictionQualityTrendReport (16 fields) + WHROutcomeRecord helper; VALID_TREND_VERDICTS (4: improving/stable/degrading/insufficient_data); DEFAULT_ROLLING_WINDOW=5, DEFAULT_ALERT_THRESHOLD=0.1; degrading triggers degradation_alert; Pearson score_hit_correlation; build() auto-computes rolling precision, trend, alert; dry_lab_only=True; 72 tests. BASELINE: 9467→9530. PR #975. Closes Phase S. | Tracks cumulative prediction quality across all confirmed WHR results; rolling precision/accuracy trend; degradation alerts; closes Phase S. | C |
238
+
239
+
## Phase T: Batch traceability and cross-batch audit (T1–T5)
240
+
241
+
| ID | Task | Why it matters | Priority |
242
+
|----|------|----------------|----------|
243
+
| T1 | Add batch traceability index schema (BTI-). | Per-batch index linking every candidate family in the batch to its evidence artifacts (BSP/SEG/ECC/STL/RSR/PQT); required_artifact_ids computed; completeness_grade (complete/partial/empty); enables cross-batch audit. | C |
244
+
| T2 | Add cross-batch audit summary schema (CBA2-). | Aggregates BTI records across all batches; counts families per grade; flags batches with low completeness; required for multi-batch meta-analysis. | C |
245
+
| T3 | Add batch evidence gap report schema (BEG-). | Per-batch listing of which artifact types are missing across all families; prioritized gap list; enables targeted evidence collection. | C |
246
+
| T4 | Add selection audit trail schema (SAT-). | Immutable ordered log of every selection/rejection decision with evidence_artifact_ids and rationale; enables full auditability from nomination to wet-lab shortlist. | C |
247
+
| T5 | Add pipeline completeness certificate schema (PCC-). | Top-level certificate asserting that all required evidence schemas are present for a given pipeline run; completeness_grade (A–D); closes Phase T. | C |
0 commit comments