|
| 1 | +# Ultimate Agent Prompt for Open Problem Lab |
| 2 | + |
| 3 | +This is the complete orientation prompt for any agent contributing to Open Problem Lab. Copy the prompt below into Claude, GPT, Gemini, Cursor, Windsurf, Copilot, or any agent that can read and edit repository files. It routes the agent in one pass and constrains it against the failure modes that matter. |
| 4 | + |
| 5 | +If the agent supports a config file (Cursor, Windsurf, Copilot, Claude Code), it will already auto-detect the right guide. In that case, this prompt is the explicit, self-contained version of what the config file says. |
| 6 | + |
| 7 | +--- |
| 8 | + |
| 9 | +## Copy-paste prompt |
| 10 | + |
| 11 | +> You are about to contribute to Open Problem Lab, a GitHub-native verification protocol for AI-generated scientific and technical claims. The thesis: make false AI-generated knowledge harder to merge. The real product is not any single claim, dataset, or analysis. The real product is the verification protocol itself. |
| 12 | +> |
| 13 | +> Before you do anything else, read these files in order and confirm you understand them: |
| 14 | +> |
| 15 | +> 1. `AGENTS.md` -- canonical agent guide. Quality ratchet, claim lifecycle, self-improvement loop, anti-patterns. |
| 16 | +> 2. `SKILL.md` -- street-smart contribution patterns. Narrow done conditions, kill conditions, decay handling. |
| 17 | +> 3. `CLAUDE.md` -- quick-reference rules, commands, role guides, schemas. |
| 18 | +> 4. `SAFETY.md` -- risk levels, prohibited shortcuts, burden of proof. |
| 19 | +> 5. `schemas/claim.schema.json` -- the core thesis object. A persistent, falsifiable statement with a verification lifecycle, evidence links, failure modes, a kill condition, and required reviewer roles. Read every field. |
| 20 | +> 6. `schemas/replication.schema.json` -- how independent replication is recorded. |
| 21 | +> 7. `schemas/evidence.schema.json` -- evidence record structure, including model-prediction, computational-analysis, and wet-lab-confirmation types. |
| 22 | +> 8. `schemas/agent-submission.schema.json` -- submission structure, including the required kill_condition field. |
| 23 | +> 9. `docs/AGENT-FAQ.md` -- common rejection patterns and how to recover. |
| 24 | +> 10. `agent-radar.json` -- routing layer for best first moves, unlock paths, reviewer bottlenecks, and protocol alerts. |
| 25 | +> 11. `tasks-available.json` -- machine-readable index of every scoped task with pack_id, task_id, owner_role, reviewer_needed, safety_risk, done_condition. |
| 26 | +> |
| 27 | +> Then read the relevant `problem.md` at the pointer in the task entry. |
| 28 | +> |
| 29 | +> Pick exactly one task whose `owner_role` matches a role you can carry out. Prefer a task surfaced in `agent-radar.json` unless you have a strong reason not to. Read the role guide at `agents/<owner_role>.md`. |
| 30 | +> |
| 31 | +> The seven constraints: |
| 32 | +> |
| 33 | +> 1. One task, one role, one claim per submission. Do not mix roles. Do not bundle independent claims. |
| 34 | +> 2. Every claim has a kill condition: the specific observation that would make it false. If nothing could falsify it, it is not a claim. |
| 35 | +> 3. Evidence is dated, sourced, and limited: source title, stable URL (prefer DOI or archive snapshot), source date, access date, method, specific limitations. |
| 36 | +> 4. Negative results are first-class. A clear method that finds no signal is more valuable than a dramatic claim with thin proof. |
| 37 | +> 5. Never weaken a schema, validator, or safety gate to merge. Fix the contribution, not the validator. |
| 38 | +> 6. Never edit `docs/wiki/` directly. Run the build command to regenerate it. |
| 39 | +> 7. Do not generate multiple variants of the same submission. One per task. Read rejections, recover, do not resubmit near-identical variants. |
| 40 | +> |
| 41 | +> If your task produces a claim, create or update a `claims.json` file in the pack directory. Every claim must validate against `schemas/claim.schema.json`. Include the falsifiable statement, evidence IDs from `evidence.json`, failure modes, kill condition, required reviewers, safety level, and submitter identity. |
| 42 | +> |
| 43 | +> If your contribution is `safety_risk: high`, it requires red-team review and replication. Do not skip these by reframing the task. |
| 44 | +> |
| 45 | +> Workflow: |
| 46 | +> |
| 47 | +> 1. Pick a task from `tasks-available.json`. |
| 48 | +> 2. Open a GitHub Issue using `.github/ISSUE_TEMPLATE/agent-submission.yml` with the task `task_id`. |
| 49 | +> 3. Make the canonical-file changes needed to satisfy the done condition. Match the structure of the existing pack at `problem-packs/climate-health/dengue-heat-vietnam/` as your calibration sample. |
| 50 | +> 4. Run validation. If it passes, run the build command. Commit both the canonical-file changes and the regenerated docs. |
| 51 | +> 5. Open a pull request linking the Issue. In the PR body include: issue linked, files changed, evidence added or changed, validation method, known limitations, kill condition, reviewer type needed. |
| 52 | +> 6. If you noticed any validator gap, schema looseness, agent-guide blind spot, or workflow friction, include a `Protocol Notes` heading in the PR body listing each. Omit the heading if nothing is worth noting. |
| 53 | +> |
| 54 | +> When your PR is reviewed: |
| 55 | +> |
| 56 | +> - If approved, your work is done. The reviewer merges. |
| 57 | +> - If rejected, read the rejection. Match it to a pattern in `docs/AGENT-FAQ.md` and recover. Do not resubmit a near-identical variant -- that is treated as spam. |
| 58 | +> - If a reviewer asks for replication, provide the exact command, input hash, and environment notes. Use `schemas/replication.schema.json` as the structure. |
| 59 | +> |
| 60 | +> Confirm you have read and understood all of the above. Then state the `task_id` you intend to work on and why you picked it. Do not start the work until you have confirmed the task choice. |
| 61 | +
|
| 62 | +--- |
| 63 | + |
| 64 | +## What the prompt is doing |
| 65 | + |
| 66 | +- **Routes the agent to canonical guides first** so it picks up the operating rules before producing output. |
| 67 | +- **Forces a single-task choice** via `tasks-available.json`. Eliminates the "agent generates a 20-bullet plan covering everything" failure mode. |
| 68 | +- **Bakes in the claim lifecycle** so agents understand that verification is a multi-stage process, not a single submission. |
| 69 | +- **Requires kill conditions** so every claim is falsifiable by construction, not by aspiration. |
| 70 | +- **Names the calibration sample** (`dengue-heat-vietnam`) so output matches existing structure. |
| 71 | +- **Bakes in the Protocol Notes convention** so the agent friction becomes signal, not lost. |
| 72 | +- **Requires confirmation before work starts** -- gives the operator a checkpoint to redirect if the agent picked a poorly fitting task. |
| 73 | + |
| 74 | +## Variations |
| 75 | + |
| 76 | +For Claude Code specifically, you do not need this prompt -- `CLAUDE.md` is auto-detected. Use this prompt for agents whose harness does not yet support an AGENTS.md / llms.txt convention. |
| 77 | + |
| 78 | +For non-coding agents (research, retrieval, synthesis), prepend: "You will not edit files. Your job is to produce a draft submission matching `schemas/agent-submission.schema.json` that a human can review and convert into a PR." |
| 79 | + |
| 80 | +## Verification |
| 81 | + |
| 82 | +Before considering this prompt good for your loop, test it once end-to-end on a low-risk pack (e.g., a `literature-scout` task on a `safety_risk: low` pack). Confirm the agent: |
| 83 | + |
| 84 | +1. Picks the right files to read. |
| 85 | +2. Picks a task that matches its claimed role. |
| 86 | +3. Produces a submission that passes validation. |
| 87 | +4. Does not invent a new schema field. |
| 88 | +5. Includes a kill condition in every claim. |
| 89 | + |
| 90 | +If any of those fails, the prompt or the agent harness needs adjustment. |
0 commit comments