You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Terminology: unqualified v1 and v2 name problem sets. The platform
work is the lifecycle overhaul; machine-format versions are always
qualified as schema version 2. Frozen identifiers and filenames remain
unchanged.
The detailed decision and operator procedures live in docs/overhaul-rollout-runbook.md. Use this single tracker rather than opening
one issue per lane.
Decisions
D1: keep raw production and staging State private and publish a
reproducible, schema-validated public projection.
D2: mechanical base rule selected: visible formalization-evaluation
problems with fewer than three accepted solves and no public submission
(118 at the audited snapshot). Ten later merged problems were explicitly
approved as additions; the final frozen v1 set has 128 members.
D3: approve both software-verification statements; retain both problems,
apply the researched title/prose/citation corrections, and add the three
agreed anti-vacuity requirements before publication.
D4: use isolated temporary account lean-eval
(a46b90978a1c29cc4795f30677e7e4b8) and exact lean-eval.workers.dev endpoints for the intake-disabled bootstrap;
never reuse or rename the Palomar subdomain. Kim Morrison is
administrator and temporary cost owner. A later organization-account or
provider migration is supported by the stable contracts, not required
for this bootstrap. This decision authorizes only the intake-disabled
bootstrap; production intake still requires either the locked
organization-owned hostname/OAuth design or an explicit recorded
amendment to that launch requirement.
D5: bootstrap with separate Kim-owned fine-grained PATs for staging and
production State, each single-repository scoped and at most 90 days;
rotate at least 14 days before expiry. The bootstrap is approved for
initial staging and production intake once each token and its narrowly
named ruleset bypass pass an environment-specific write test.
D6: approve key lifecycle, one-submission capability, contributor
acknowledgement, and license wording before private intake/release. D6a
selects a new dedicated AWS account with AWS KMS behind a
provider-neutral wrap/unwrap adapter; migration rewraps identities without
changing archives or stable IDs. D6b accepts no provider-loss recovery.
The capability implementation is delegated to the implementation review;
concise contributor/release wording is approved.
D7: approve fresh dry run 32569220655 at source ddc0e4ec, source
digest 884c3837, 1,298 records, and output digest b78fb207; apply run 32569936026 completed as c3491661 and independent validation passed.
D8: acknowledge UUID-prefix State paths and the durable Git writer lock
as correctness-preserving deviations from the literal program text.
D9: use two least-privilege GitHub Apps behind an organization-operated
token broker; implementation identifiers are recorded when provisioned.
D10: use a two-UTC-calendar-month embargo and initially plan a four-week
issue-intake overlap. A later explicit maintainer decision may shorten
the issue overlap and must be announced before closure.
Repository and contract foundations
Create and publish lean-eval-generator.
Create and publish production State with the D1 visibility.
Create and publish staging State with the D1 visibility.
Create and publish disabled lean-eval-releases tooling.
Replace LeanEval's local generator path with an exact public commit SHA.
Verify generator byte parity after the remote pin (theorem- and
definition-hole fixtures, 10/10 files each).
Merge generator fixes lean-eval-generator#1 / #2 and synchronization
PR #3, advance exact pins, rerun corpus parity, and merge the
embedded-core removal in lean-eval#553. All three generator PRs merged
into exact main commit 77373a53; consumer #553 merged as b91d4757, after local parity/build/test checks and hosted run 32559642804 passed all eight catalog shards, the inventory aggregate,
repository checks, and security/scoring smoke tests.
Configure State rulesets and append-only validation.
Publish the schema-validated public projection of private production
State without exposing private source or operational metadata
(lean-eval-state#4; staging mirror lean-eval-state-staging#4).
Complete lifecycle-aware leaderboard consumption and publish the exact
validated projection (lean-eval-leaderboard#72, merge dd5d508d; Pages
deployment run 32557778003).
Existing-repository PRs
Open catalog lifecycle/tags/audit PR.
Open results schema version 2 compatibility and migration-tooling PR.
Open intake-disabled Worker, deployment, rollback, threat-model, and
infrastructure-ledger PR.
Open lifecycle-aware leaderboard preview PR.
Open software-verification draft PR after D3 review.
Open LeanEval generator-consumer PR after the public generator pin exists.
Open independent-kernel shadow smoke lean-eval-submissions#1207 and
AWS one-submission key-adapter staging smoke #1208; both merged and
deployed intake-disabled as exact commit a34b2053.
Provision dedicated AWS account 161072922960, exact GitHub OIDC
provider, and isolated staging/production key-adapter stacks. Only the
staging wrap and replay-invoker role variables are connected; production
remains dormant and intake-disabled.
Pass the synthetic staging key-adapter round trip from protected immutable
commit d487c9d5 (run 32568604230): Encrypt-only wrap, source-free
handoff, Invoke-only unwrap, second-use rejection, authority removal, and
local decryption. This is not a private replay/backend demonstration.
Merge disabled release terminology lean-eval-releases#3, planner #1,
and reconstruction smoke #2; final main is f1f83344, all hosted
validation is green, and publication remains disabled.
Lifecycle product contracts
These are required by the authoritative product plan and remain separate from
the already implemented owner status, metadata, and publication routes.
Add the production State representation for legacy result claims and
metadata backfill without rewriting historical facts
(lean-eval-state#8, merge 6ba71d2a). The v1 public projection remains
byte-for-byte stable and the redacted lifecycle metadata is opt-in v2.
Add the authenticated owner writer/API for those State events, including
owner verification and exact results-Git tuple/digest recomputation;
preserve the stable result identifier and grandfathered release policy.
Add model-alias, rename, consolidation, and new-canonical-identity
request events, authorization, materialization, collision tests, and
lifecycle-aware public projection behavior.
Add problem-repair requests and maintainer repair events with explicit
revision/causation rules; do not rewrite prior accepted records.
Add owner retraction requests and public maintainer override/retraction
events, including release and leaderboard consequences.
Add hostile-input, owner/maintainer authorization, idempotence, causal
conflict, and public-redaction tests for every amendment flow.
Cloudflare bootstrap
Create protected cloudflare-staging and cloudflare-production GitHub
environments.
Install the Cloudflare account ID in both environments.
Install distinct scoped deployment API tokens in those environments.
Add Containers: Edit to both existing account-scoped deployment tokens;
operator-confirmed 2026-08-22, retaining Workers Scripts: Edit and no
other account or zone permission. Live verification remains part of the
first staging container deployment.
Create the protected submission-dispatch-promotion environment and the
immutable lean-eval-dispatch/* tag ruleset.
Install distinct random AUTH_TOKEN_SECRET and READINESS_TOKEN values.
Create distinct staging/production GitHub OAuth Apps with exact callback
URLs and install their credentials.
Deploy staging manually with intake disabled and record the Worker, workers.dev endpoint, account, subdomain, and version identifiers.
Promote the same commit to production and verify the structured health
response.
Install distinct readiness secrets in each Worker.
Obtain organization approval for the installed, distinct State-writer
credentials and test each with its matching ruleset bypass (preflight
runs 32465890236 and 32465892118).
Implement the D9 private service-binding broker and separate source and
dispatch authority paths.
Deploy both private brokers and bind the intake-disabled staging and
production Workers to them.
Create both Apps, install the dispatcher on only the submissions
repository, and provision both broker environments; keep the local static
verification/dispatch-token hooks absent in production.
Complete the ownership transfers of both broker GitHub Apps to leanprover; public records and protected preflights verify unchanged
App IDs, working private keys, and dispatcher installation 155329316.
Replace the credentialed private-gist assumption with anonymous exact-ID
verification of GitHub's unlisted secret gist, while retaining exact
owner/content/visibility/truncation checks and keeping the broker closed
to /gists/.
Data and product rollout
Produce a fresh results schema version 2 dry-run artifact.
Review and approve dry run 32569220655 and its exact source commit,
source digest, 1,298-record count, and canonical output digest (D7).
Execute authorized run 32569936026; main c3491661 contains 44/44
schema-version-2 files, the writer lock is absent, no record was lost or
duplicated, no submission writer is queued, and main CI is green.
Define and audit the approved mechanical 118-member v1 base set.
Freeze the v1 set when its reviewed PR merges (lean-eval#540,
merge commit 547b00ed345bc0737dd94847d6b67cb681b6178a).
Add the ten explicitly approved post-audit problems in lean-eval#548;
final v1 membership is 128 at merge 21c6c021.
Complete staging OAuth/agent intake and exact-ref dispatch. Hosted run 32546606639 archived the exact private fixture, produced the deliberate
rejection, and recorded archive completion plus evaluation start/reject
events through staging State commit b2160515; no accepted result was
written.
Demonstrate credential-free historical public replay (hosted run 32499490261, workflow commit 757b0831).
Demonstrate isolated private replay. Protected deployment run 32573880099 and source-free acceptance run 32574078784 prove the
12 GiB, max-one-instance, SSH-off, network-disabled Cloudflare Sandbox,
exact GitHub OIDC boundary, fixed-command decrypt, and destruction. The
provider-neutral contract and automatic deployment are live; general and
production replay remain disabled.
Verify synthetic single-archive decrypt, second-use and wrong-archive
refusal, blocked egress, and sandbox destruction before enabling private
replay. Evidence is recorded in INFRASTRUCTURE.md.
Prove the same boundary with a real accepted schema-version-3 staging
archive. Immutable-tag run 32618166048 selected submission 01a02cb4-5e7c-7fb3-a4ab-b6fabbb72584 from State, consumed and refused
reuse of its exact KMS capability, verified the plaintext digest and safe
archive shape only inside the network-disabled Sandbox, and confirmed
destruction without any write authority. Authoritative queue execution
and production replay remain disabled.
Demonstrate release reconstruction separately without enabling release
or publication. Protected lean-eval-releases run 32574614106 at exact
main commit f1f83344 planned one due synthetic release, reconstructed
and validated its manifest, enforced the public-file allowlist, excluded
a private fixture file, and left Git and State unchanged.
Run the one authorized receipt-backed authoritative staging replay. Run 32694194843 reached an explicit retryable replay.failed terminal at
staging State commit c3c677cc with reason runner_lost; no successful
replay evidence was fabricated. Replay was immediately disabled again in
both environments by lean-eval-submissions#1299 at ffd9a473, deploy
run 32700136536 passed, both live health endpoints report disabled, and
Cloudflare reports zero active or assigned replay containers.
Inventory every historical accepted result at the migration cutoff and
deterministically classify it as public-source replayable,
private-archive replayable, or explicitly unavailable with a reviewed
reason.
Enqueue and execute the complete historical replay corpus under exact
original pins, recording terminal verdicts/statistics or explicit
unavailability; the isolated staging proofs above do not satisfy this
corpus gate.
Expand independent-kernel validation from the one-result shadow smoke to
a checker-series/corpus report with separately recorded
accept/reject/decline/crash/timeout outcomes and an explicit promotion
decision.
Enable production intake and begin the four-week issue-intake adoption
window.
Complete leaderboard preview review and cut over with rollback retained
(lean-eval-leaderboard#72; Pages run 32557778003).
Close issue intake only after the time, incident, submitter, adoption, and
announcement gates in the implementation program pass.
Production and operational readiness
Make production intake enablement, normal deploy smoke, credential
preflight, and rollback agree on one explicit expected intake state;
keep the tracked production value disabled until the launch review.
Provide a commit-coherent rollback procedure for the intake Worker,
private broker, and replay Worker/container deployment unit. The
qualified protected workflow merged as lean-eval-submissions#1300 at f5f830d0; main deploy run 32700644989 passed staging and production
with intake and replay disabled. State stays append-only and
forward-corrected.
Add the exact staging promotion canary required by the program: GitHub
connectivity, synthetic intake, CAS contention, and scheduled
reconciliation before a production candidate is promoted.
Validate the release controller's State and release-repository write
credentials without AWS decrypt or publication. Protected run 32694754911 at release commit 2a4cdff2 passed both exact-ref dry-run
pushes while publication remained absent.
Pass the credentialed staging release smoke after the live AWS OIDC trust
update. Keep publication disabled until its separate launch gate.
Add the publication-disabled confidentiality-incident recovery planner
(lean-eval-releases#8, merge d66c8dd), including strict original
publication bindings, canonical shared-path classification, and a
fail-closed remediation plan that performs no mutation.
Complete and merge the immutable release.removed State correction
contract, then bind the recovery planner to it and qualify the protected
repository-removal/history-cleanup procedure without rewriting results.
Record and deploy the readiness monitor, alert destination, severity
owner, support contact, emergency intake-pause owner, and response
procedure (lean-eval-submissions#1301, merge 58d88268). Main deploy
run 32701229915 passed in both environments with intake/replay disabled;
protected live monitor run 32701461244 then verified the exact deployed
commit and reconciled the bot-owned incident state.
Move the production hostname and OAuth Apps to organization ownership as
required by the locked program, or record an explicit reviewed amendment
authorizing the temporary workers.dev/owner arrangement for launch.
Reconcile the rollout runbook, infrastructure current-version table,
credential rotation/revocation data, and public implementation tracker
after each remaining protected rollout.
External coordination
Coordinate the published generator contract through lean-eval#533 and
formal-conjectures#4951.
Close the whole-FC100 extraction findings in the FC-owned importer:
current formal-conjectures#4951 imports, verifies, classifies, and
generates all 100 declarations (92 research-open and 8 research-solved).
Its pinned baseline builds 97/100 at LeanEval pins with three exact known
failures; generator PRs #1 / #2 retire Erdos125, and the independently
verified FC toolchain bump retires the remaining two.
Reproduce the FC100 dependency audit before import: 100/100 declarations
resolved, 280 closure edges, no target-to-target dependency, and one
fail-closed Erdos324.erdos_324.match_1 orphan recorded upstream.
Obtain a compatible FC-owned importer/output contract with strict,
deterministic provenance as a reference implementation
(formal-conjectures#4951, previously green at head 2654e42de2026de6cdb248ad5ed0f1c7d659c8fa). The draft must still be
reconciled with current FC main, current Lean pins, and maintainer
review before it is launch-ready.
Launch FC100/open-conjectures only after generator pins advance, the
importer receives FC maintainer review, and the production launch gates
are satisfied.
Complete the human-authored flavour-text/hint audit; tooling may inventory
missing or stale text, but agents do not author hints.
After FC100 proof-only launch, coordinate comparator disproof support and
add the generator/manifest disproof contract once the upstream comparator
integration lands.
[lifecycle overhaul] implementation tracker
Tracks implementation and production rollout of the plan in
lean-eval#536 and the
public implementation program.
Terminology: unqualified v1 and v2 name problem sets. The platform
work is the lifecycle overhaul; machine-format versions are always
qualified as schema version 2. Frozen identifiers and filenames remain
unchanged.
The detailed decision and operator procedures live in
docs/overhaul-rollout-runbook.md. Use this single tracker rather than openingone issue per lane.
Decisions
reproducible, schema-validated public projection.
problems with fewer than three accepted solves and no public submission
(118 at the audited snapshot). Ten later merged problems were explicitly
approved as additions; the final frozen v1 set has 128 members.
apply the researched title/prose/citation corrections, and add the three
agreed anti-vacuity requirements before publication.
lean-eval(
a46b90978a1c29cc4795f30677e7e4b8) and exactlean-eval.workers.devendpoints for the intake-disabled bootstrap;never reuse or rename the Palomar subdomain. Kim Morrison is
administrator and temporary cost owner. A later organization-account or
provider migration is supported by the stable contracts, not required
for this bootstrap. This decision authorizes only the intake-disabled
bootstrap; production intake still requires either the locked
organization-owned hostname/OAuth design or an explicit recorded
amendment to that launch requirement.
production State, each single-repository scoped and at most 90 days;
rotate at least 14 days before expiry. The bootstrap is approved for
initial staging and production intake once each token and its narrowly
named ruleset bypass pass an environment-specific write test.
acknowledgement, and license wording before private intake/release. D6a
selects a new dedicated AWS account with AWS KMS behind a
provider-neutral wrap/unwrap adapter; migration rewraps identities without
changing archives or stable IDs. D6b accepts no provider-loss recovery.
The capability implementation is delegated to the implementation review;
concise contributor/release wording is approved.
32569220655at sourceddc0e4ec, sourcedigest
884c3837, 1,298 records, and output digestb78fb207; apply run32569936026completed asc3491661and independent validation passed.as correctness-preserving deviations from the literal program text.
token broker; implementation identifiers are recorded when provisioned.
issue-intake overlap. A later explicit maintainer decision may shorten
the issue overlap and must be announced before closure.
Repository and contract foundations
lean-eval-generator.lean-eval-releasestooling.definition-hole fixtures, 10/10 files each).
lean-eval-generator#1/#2and synchronizationPR
#3, advance exact pins, rerun corpus parity, and merge theembedded-core removal in
lean-eval#553. All three generator PRs mergedinto exact main commit
77373a53; consumer#553merged asb91d4757, after local parity/build/test checks and hosted run32559642804passed all eight catalog shards, the inventory aggregate,repository checks, and security/scoring smoke tests.
State without exposing private source or operational metadata
(
lean-eval-state#4; staging mirrorlean-eval-state-staging#4).validated projection (
lean-eval-leaderboard#72, mergedd5d508d; Pagesdeployment run
32557778003).Existing-repository PRs
infrastructure-ledger PR.
lean-eval-submissions#1207andAWS one-submission key-adapter staging smoke
#1208; both merged anddeployed intake-disabled as exact commit
a34b2053.161072922960, exact GitHub OIDCprovider, and isolated staging/production key-adapter stacks. Only the
staging wrap and replay-invoker role variables are connected; production
remains dormant and intake-disabled.
commit
d487c9d5(run32568604230): Encrypt-only wrap, source-freehandoff, Invoke-only unwrap, second-use rejection, authority removal, and
local decryption. This is not a private replay/backend demonstration.
lean-eval-releases#3, planner#1,and reconstruction smoke
#2; final main isf1f83344, all hostedvalidation is green, and publication remains disabled.
Lifecycle product contracts
These are required by the authoritative product plan and remain separate from
the already implemented owner status, metadata, and publication routes.
metadata backfill without rewriting historical facts
(
lean-eval-state#8, merge6ba71d2a). The v1 public projection remainsbyte-for-byte stable and the redacted lifecycle metadata is opt-in v2.
owner verification and exact results-Git tuple/digest recomputation;
preserve the stable result identifier and grandfathered release policy.
request events, authorization, materialization, collision tests, and
lifecycle-aware public projection behavior.
revision/causation rules; do not rewrite prior accepted records.
events, including release and leaderboard consequences.
conflict, and public-redaction tests for every amendment flow.
Cloudflare bootstrap
cloudflare-stagingandcloudflare-productionGitHubenvironments.
operator-confirmed 2026-08-22, retaining Workers Scripts: Edit and no
other account or zone permission. Live verification remains part of the
first staging container deployment.
submission-dispatch-promotionenvironment and theimmutable
lean-eval-dispatch/*tag ruleset.AUTH_TOKEN_SECRETandREADINESS_TOKENvalues.URLs and install their credentials.
workers.devendpoint, account, subdomain, and version identifiers.response.
credentials and test each with its matching ruleset bypass (preflight
runs
32465890236and32465892118).dispatch authority paths.
production Workers to them.
repository, and provision both broker environments; keep the local static
verification/dispatch-token hooks absent in production.
leanprover; public records and protected preflights verify unchangedApp IDs, working private keys, and dispatcher installation
155329316.verification of GitHub's unlisted secret gist, while retaining exact
owner/content/visibility/truncation checks and keeping the broker closed
to
/gists/.Data and product rollout
32569220655and its exact source commit,source digest, 1,298-record count, and canonical output digest (D7).
32569936026; mainc3491661contains 44/44schema-version-2 files, the writer lock is absent, no record was lost or
duplicated, no submission writer is queued, and main CI is green.
lean-eval#540,merge commit
547b00ed345bc0737dd94847d6b67cb681b6178a).lean-eval#548;final v1 membership is 128 at merge
21c6c021.32546606639archived the exact private fixture, produced the deliberaterejection, and recorded archive completion plus evaluation start/reject
events through staging State commit
b2160515; no accepted result waswritten.
32499490261, workflow commit757b0831).32573880099and source-free acceptance run32574078784prove the12 GiB, max-one-instance, SSH-off, network-disabled Cloudflare Sandbox,
exact GitHub OIDC boundary, fixed-command decrypt, and destruction. The
provider-neutral contract and automatic deployment are live; general and
production replay remain disabled.
refusal, blocked egress, and sandbox destruction before enabling private
replay. Evidence is recorded in
INFRASTRUCTURE.md.archive. Immutable-tag run
32618166048selected submission01a02cb4-5e7c-7fb3-a4ab-b6fabbb72584from State, consumed and refusedreuse of its exact KMS capability, verified the plaintext digest and safe
archive shape only inside the network-disabled Sandbox, and confirmed
destruction without any write authority. Authoritative queue execution
and production replay remain disabled.
or publication. Protected
lean-eval-releasesrun32574614106at exactmain commit
f1f83344planned one due synthetic release, reconstructedand validated its manifest, enforced the public-file allowlist, excluded
a private fixture file, and left Git and State unchanged.
32694194843reached an explicit retryablereplay.failedterminal atstaging State commit
c3c677ccwith reasonrunner_lost; no successfulreplay evidence was fabricated. Replay was immediately disabled again in
both environments by
lean-eval-submissions#1299atffd9a473, deployrun
32700136536passed, both live health endpoints report disabled, andCloudflare reports zero active or assigned replay containers.
deterministically classify it as public-source replayable,
private-archive replayable, or explicitly unavailable with a reviewed
reason.
original pins, recording terminal verdicts/statistics or explicit
unavailability; the isolated staging proofs above do not satisfy this
corpus gate.
a checker-series/corpus report with separately recorded
accept/reject/decline/crash/timeout outcomes and an explicit promotion
decision.
window.
(
lean-eval-leaderboard#72; Pages run32557778003).announcement gates in the implementation program pass.
Production and operational readiness
preflight, and rollback agree on one explicit expected intake state;
keep the tracked production value disabled until the launch review.
private broker, and replay Worker/container deployment unit. The
qualified protected workflow merged as
lean-eval-submissions#1300atf5f830d0; main deploy run32700644989passed staging and productionwith intake and replay disabled. State stays append-only and
forward-corrected.
connectivity, synthetic intake, CAS contention, and scheduled
reconciliation before a production candidate is promoted.
credentials without AWS decrypt or publication. Protected run
32694754911at release commit2a4cdff2passed both exact-ref dry-runpushes while publication remained absent.
update. Keep publication disabled until its separate launch gate.
(
lean-eval-releases#8, merged66c8dd), including strict originalpublication bindings, canonical shared-path classification, and a
fail-closed remediation plan that performs no mutation.
release.removedState correctioncontract, then bind the recovery planner to it and qualify the protected
repository-removal/history-cleanup procedure without rewriting results.
owner, support contact, emergency intake-pause owner, and response
procedure (
lean-eval-submissions#1301, merge58d88268). Main deployrun
32701229915passed in both environments with intake/replay disabled;protected live monitor run
32701461244then verified the exact deployedcommit and reconciled the bot-owned incident state.
required by the locked program, or record an explicit reviewed amendment
authorizing the temporary
workers.dev/owner arrangement for launch.credential rotation/revocation data, and public implementation tracker
after each remaining protected rollout.
External coordination
formal-conjectures#4951.
current
formal-conjectures#4951imports, verifies, classifies, andgenerates all 100 declarations (92 research-open and 8 research-solved).
Its pinned baseline builds 97/100 at LeanEval pins with three exact known
failures; generator PRs
#1/#2retire Erdos125, and the independentlyverified FC toolchain bump retires the remaining two.
resolved, 280 closure edges, no target-to-target dependency, and one
fail-closed
Erdos324.erdos_324.match_1orphan recorded upstream.deterministic provenance as a reference implementation
(
formal-conjectures#4951, previously green at head2654e42de2026de6cdb248ad5ed0f1c7d659c8fa). The draft must still bereconciled with current FC
main, current Lean pins, and maintainerreview before it is launch-ready.
importer receives FC maintainer review, and the production launch gates
are satisfied.
missing or stale text, but agents do not author hints.
add the generator/manifest disproof contract once the upstream comparator
integration lands.