|
| 1 | +# Field Validity Checklist |
| 2 | + |
| 3 | +Open Problem Lab should distinguish a claim that is true in a document from a claim that remains useful in the field. |
| 4 | + |
| 5 | +This checklist helps reviewers and agents test whether a contribution survives contact with implementation constraints: geography, capacity, incentives, timing, procurement, data access, and local trust. |
| 6 | + |
| 7 | +## When to use this checklist |
| 8 | + |
| 9 | +Use it when a claim would affect real-world prioritization, operations, funding, policy, tooling, or field practice. |
| 10 | + |
| 11 | +A claim can be well-sourced and still fail field validity. Field validity asks whether the claim remains decision-useful under the conditions where someone would act on it. |
| 12 | + |
| 13 | +## Minimum questions |
| 14 | + |
| 15 | +A submission should answer the relevant questions below. |
| 16 | + |
| 17 | +1. **Actor:** Who would act on this claim? |
| 18 | +2. **Decision:** What decision would change if the claim is accepted? |
| 19 | +3. **Setting:** Which geography, institution type, population, season, or delivery channel is assumed? |
| 20 | +4. **Capacity:** What staff, budget, equipment, permission, data, or logistics are required? |
| 21 | +5. **Timing:** Does the claim depend on seasonality, crisis timing, supply cycles, school calendars, elections, procurement windows, or reporting delays? |
| 22 | +6. **Incentives:** Who benefits, who pays, who bears risk, and who can block implementation? |
| 23 | +7. **Data path:** Can the actor actually obtain the data needed to use the claim? |
| 24 | +8. **Failure mode:** What is the most likely way the claim becomes misleading when applied locally? |
| 25 | +9. **Equity boundary:** Who might be excluded, harmed, or mismeasured by the proposed use? |
| 26 | +10. **Status:** Should the claim be accepted, field-pending, bounded, or rejected for the stated use? |
| 27 | + |
| 28 | +## Output format |
| 29 | + |
| 30 | +```markdown |
| 31 | +## Field validity note |
| 32 | + |
| 33 | +**Claim:** Link to claim, issue, evidence record, or PR. |
| 34 | + |
| 35 | +**Actor and decision:** Who would use this, and what decision would change? |
| 36 | + |
| 37 | +**Assumed setting:** Geography, institution type, population, timing, and delivery channel. |
| 38 | + |
| 39 | +**Required capacity:** Staff, budget, permissions, data, equipment, logistics, or partner dependencies. |
| 40 | + |
| 41 | +**Most likely field failure:** One concrete failure mode. |
| 42 | + |
| 43 | +**Boundary:** Where this claim should not be used. |
| 44 | + |
| 45 | +**Recommended status:** accepted | bounded | field-pending | disputed | rejected for field use. |
| 46 | + |
| 47 | +**Cheapest field check:** The smallest safe check that would reveal whether the field assumption is false. |
| 48 | +``` |
| 49 | + |
| 50 | +## Reviewer guidance |
| 51 | + |
| 52 | +Reviewers should not require full deployment proof for every claim. That would freeze the repo. |
| 53 | + |
| 54 | +But reviewers should require honest boundaries when a submission implies action. The correct outcome is often not rejection; it is a narrower status such as `field-pending` or `bounded`. |
| 55 | + |
| 56 | +## Agent guidance |
| 57 | + |
| 58 | +An agent should never convert desk evidence into field readiness by tone alone. |
| 59 | + |
| 60 | +Before presenting a claim as actionable, the agent should state the actor, the decision, and the field condition that could break the claim. |
| 61 | + |
| 62 | +## Acceptance test |
| 63 | + |
| 64 | +This checklist is satisfied when a field practitioner could read the note and know whether the claim helps their decision, needs local verification, or should not be used in their setting. |
0 commit comments