Skip to content
counterfactual-replay

feat(calibration): counterfactual prompt replay — offline harness + budget-gated advisory CI check #1

Sign in to view logs

feat(calibration): counterfactual prompt replay — offline harness + budget-gated advisory CI check

feat(calibration): counterfactual prompt replay — offline harness + budget-gated advisory CI check #1

Triggered via pull request July 23, 2026 21:45
@JSONboredJSONbored
opened #8271
feat/counterfactual-replay-harness
Status Success
Total duration 51s
Artifacts –

counterfactual-replay-check.yml

on: pull_request
counterfactual replay (advisory)
3s
counterfactual replay (advisory)
counterfactual replay (skipped for fork PRs)
0s
counterfactual replay (skipped for fork PRs)
Fit to window
Zoom out
Zoom in

Annotations

1 notice
counterfactual replay (advisory)
Counterfactual replay skipped: no replay budget configured (set the COUNTERFACTUAL_REPLAY_BUDGET + COUNTERFACTUAL_REPLAY_MODEL repo variables and the COUNTERFACTUAL_OLLAMA_URL secret to enable). Advisory only, never fails the PR.