Skip to content

Commit d95f810

Browse files
authored
docs: add field validity checklist
1 parent ef99ea9 commit d95f810

1 file changed

Lines changed: 64 additions & 0 deletions

File tree

‎docs/FIELD-VALIDITY-CHECKLIST.md‎

Lines changed: 64 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,64 @@
1+
# Field Validity Checklist
2+
3+
Open Problem Lab should distinguish a claim that is true in a document from a claim that remains useful in the field.
4+
5+
This checklist helps reviewers and agents test whether a contribution survives contact with implementation constraints: geography, capacity, incentives, timing, procurement, data access, and local trust.
6+
7+
## When to use this checklist
8+
9+
Use it when a claim would affect real-world prioritization, operations, funding, policy, tooling, or field practice.
10+
11+
A claim can be well-sourced and still fail field validity. Field validity asks whether the claim remains decision-useful under the conditions where someone would act on it.
12+
13+
## Minimum questions
14+
15+
A submission should answer the relevant questions below.
16+
17+
1. **Actor:** Who would act on this claim?
18+
2. **Decision:** What decision would change if the claim is accepted?
19+
3. **Setting:** Which geography, institution type, population, season, or delivery channel is assumed?
20+
4. **Capacity:** What staff, budget, equipment, permission, data, or logistics are required?
21+
5. **Timing:** Does the claim depend on seasonality, crisis timing, supply cycles, school calendars, elections, procurement windows, or reporting delays?
22+
6. **Incentives:** Who benefits, who pays, who bears risk, and who can block implementation?
23+
7. **Data path:** Can the actor actually obtain the data needed to use the claim?
24+
8. **Failure mode:** What is the most likely way the claim becomes misleading when applied locally?
25+
9. **Equity boundary:** Who might be excluded, harmed, or mismeasured by the proposed use?
26+
10. **Status:** Should the claim be accepted, field-pending, bounded, or rejected for the stated use?
27+
28+
## Output format
29+
30+
```markdown
31+
## Field validity note
32+
33+
**Claim:** Link to claim, issue, evidence record, or PR.
34+
35+
**Actor and decision:** Who would use this, and what decision would change?
36+
37+
**Assumed setting:** Geography, institution type, population, timing, and delivery channel.
38+
39+
**Required capacity:** Staff, budget, permissions, data, equipment, logistics, or partner dependencies.
40+
41+
**Most likely field failure:** One concrete failure mode.
42+
43+
**Boundary:** Where this claim should not be used.
44+
45+
**Recommended status:** accepted | bounded | field-pending | disputed | rejected for field use.
46+
47+
**Cheapest field check:** The smallest safe check that would reveal whether the field assumption is false.
48+
```
49+
50+
## Reviewer guidance
51+
52+
Reviewers should not require full deployment proof for every claim. That would freeze the repo.
53+
54+
But reviewers should require honest boundaries when a submission implies action. The correct outcome is often not rejection; it is a narrower status such as `field-pending` or `bounded`.
55+
56+
## Agent guidance
57+
58+
An agent should never convert desk evidence into field readiness by tone alone.
59+
60+
Before presenting a claim as actionable, the agent should state the actor, the decision, and the field condition that could break the claim.
61+
62+
## Acceptance test
63+
64+
This checklist is satisfied when a field practitioner could read the note and know whether the claim helps their decision, needs local verification, or should not be used in their setting.

0 commit comments

Comments
 (0)