Skip to content

refactor(db): extract authentication allowlist store - #6784

Closed
TheSentinel454 wants to merge 1 commit into
codex/issue-12-api-token-storefrom
codex/issue-12-allowlist-store
Closed

refactor(db): extract authentication allowlist store#6784
TheSentinel454 wants to merge 1 commit into
codex/issue-12-api-token-storefrom
codex/issue-12-allowlist-store

Conversation

@TheSentinel454

@TheSentinel454 TheSentinel454 commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Current reconstructed head

Exact base: codex/issue-12-api-token-store at efd769903a0aab75961453ab247bef923f64ac38
Exact head: codex/issue-12-allowlist-store at 7ae63f6be2f3f1265b976f37756f3ca0caaffa59

This current head removes crates/buzz-db/tests/store_ownership.rs; no replacement path-sensitive ownership test is introduced. Apart from removing that complete test-file diff, the production patch is byte-for-byte identical to the previously reviewed slice. This remains part of tracker #2 and the #17/#19 acceptance work.

Independent exact-head review from a separate clean Blox workstation found no issues. Current-head evidence passed formatting, strict buzz-db clippy, 111 non-PostgreSQL library tests with 200 PostgreSQL tests ignored, the observability source test, relay consumer compilation, exact ownership/unique-span review checks, and 1 allowlist PostgreSQL test on native PostgreSQL where applicable.

Why

Complete the authentication-allowlist half of tracker #2 and domain issue #12 while keeping Db as the stable public facade. This child stacks on the API-token extraction in #6783.

What

  • Add a dedicated allowlist.rs owner for AllowlistEntry, every allowlist Db method, inline SQL, focused tests, and datastore spans
  • Preserve every public Db signature and the crate-root AllowlistEntry export
  • Preserve community scoping, UPSERT/delete behavior, timestamps, row parsing, and validation/error behavior
  • Keep NIP-43 relay membership and migration/backfill orchestration outside this authentication-allowlist module

Stack

Non-goals

  • No SQL, schema, validation, retry, timeout, transaction, or client-visible behavior changes
  • No consolidation of authentication allowlisting with NIP-43 relay membership
  • No movement of cross-domain migration/backfill orchestration
  • No store traits, domain-handle redesign, broad PgExecutor migration, raw pool accessor, new crate, or directory-wide reorganization
  • No changes to, retargeting of, or merge action on parent PRs or PR Add database pressure observability #6700

Risk Assessment

Low. This is a direct ownership move. The guard also prevents relay-membership backfill orchestration from drifting into the authentication allowlist owner.

Blox Verification

Author workstation: buzz-tornquist-issue-2-store-stack (2046520), exact head f30633fc37d9b44860db5644418e066a917dc113.

  • cargo fmt --all --check — passed
  • cargo clippy -p buzz-db -p buzz-relay --all-targets -- -D warnings — passed
  • Native PostgreSQL: cargo test -p buzz-db allowlist::tests:: -- --ignored --test-threads=1 — 1 passed
  • Relay public-path/all-target compilation is covered by the relay clippy invocation
  • Commit-time formatting, sadscan, attribution, and sign-off hooks — passed

Independent exact-head review: buzz-tornquist-pr-6784-review (2049132) found no critical, important, or minor issues. The reviewer confirmed exact production method/test equivalence, one span per operation, and that NIP-43 backfill remains relay-membership owned.

Generated with Codex

Superseded pre-comment restack verification

PR #6700 merged before publication completed. This layer was restacked onto current main through the exact parent named above; the final cumulative tip is 2ddcc8a. Cumulative author gates passed: formatting and diff checks; buzz-db and buzz-relay all-target clippy with -D warnings; DB lib 111 passed / 200 ignored; ownership 22/22; observability 1/1; the full isolated PostgreSQL domain matrix; and relay lib 910 passed / 49 ignored.

  • Workstation: buzz-tornquist-pr-6784-final-review (2057622), fresh shallow checkout
  • Base: e69f4e7180eae47d96c56012f9cbea966da584e2
  • Head: b7347e78843d7b63e3cb383da7cbf5ffc956d4f0
  • Findings: none

Reviewed the authentication allowlist extraction. AllowlistEntry, community-scoped SQL, Db wrappers, test, and datastore spans move together to allowlist.rs; crate-root compatibility is retained. The module remains separate from NIP-43 relay membership and introduces no migration or backfill ownership change.

Verification: format and diff checks passed; buzz-db --all-targets clippy passed with -D warnings; DB lib tests passed (111 passed, 200 PostgreSQL tests ignored); ownership (4/4) and observability (1/1) guards passed; the allowlist PostgreSQL isolation test passed on native PostgreSQL 17 with migrations 1-32 successful; relay lib test target compiled successfully. Final worktree was detached at the exact head and clean.

Complete evidence archive SHA-256: a8fd059c66d343e4d98850cb67747a41cb8c6161f98f74f3577ec6cc547fab63.

Comment-addressed restack

Review follow-up on #6777 removed only the low-value replaceable ownership source test. This PR was restacked onto its rewritten parent; its production patch is unchanged.

  • Exact base: 7798ea83fe393cdc457577bb09a4fd7546b9722b
  • Exact head: fa88a642a7aa10ce74f8cea692653e50b427f89e
  • Final cumulative tip: 6fa2f104d42c6ba85bdf62e7ccb74ceaf4a84f67
  • Per-layer patch-ID and tree audits confirm this PR’s production diff is unchanged from its pre-comment head.
  • Cumulative Blox gate: formatting and diff checks; strict buzz-db/buzz-relay Clippy; DB lib 111 passed / 200 ignored; ownership 21/21; observability 1/1; every moved PostgreSQL test; relay lib 910 passed / 49 ignored.
  • Independent re-review at this exact head: no findings; fresh exact-parent/head Blox review passed fmt/diff, strict Clippy, DB lib 111 passed / 200 ignored, current ownership/observability guards, 1 allowlist PostgreSQL test, and relay compilation.

@TheSentinel454
TheSentinel454 force-pushed the codex/issue-12-allowlist-store branch from ce7029f to f30633f Compare August 25, 2026 16:20
@TheSentinel454
TheSentinel454 force-pushed the codex/issue-12-allowlist-store branch from f30633f to b7347e7 Compare August 25, 2026 20:06
@TheSentinel454
TheSentinel454 force-pushed the codex/issue-12-allowlist-store branch from b7347e7 to fa88a64 Compare August 25, 2026 20:59
@TheSentinel454 TheSentinel454 changed the title db: extract authentication allowlist store refactor(db): extract authentication allowlist store Aug 26, 2026
@TheSentinel454
TheSentinel454 force-pushed the codex/issue-12-allowlist-store branch from fa88a64 to e951213 Compare August 26, 2026 14:33
@TheSentinel454
TheSentinel454 force-pushed the codex/issue-12-allowlist-store branch from e951213 to 7ae63f6 Compare August 26, 2026 15:53
@TheSentinel454
TheSentinel454 marked this pull request as ready for review August 27, 2026 14:05
@TheSentinel454
TheSentinel454 requested a review from a team as a code owner August 27, 2026 14:05

@wpfleger96 wpfleger96 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 Combined review from three independent passes (two source reviews + one E2E test run at exact head 7ae63f6): no blocking findings; one MINOR (non-blocking) note below.

Verified clean:

  • Pure extraction: the five moved Db methods (is_pubkey_allowed, has_allowlist_entries, add_to_allowlist, remove_from_allowlist, list_allowlist), AllowlistEntry, and the allowlist_is_scoped_to_community test are byte-identical after relocation; every removed lib.rs line reappears verbatim. All five span names, community-scoping predicates, UPSERT idempotency, and delete scoping preserved. pub use allowlist::AllowlistEntry keeps the root path compiling; the live auth consumer in buzz-relay/src/handlers/auth.rs is unchanged.
  • The backfill boundary is deliberate and correct: backfill_from_allowlist stays with the relay_members owner because it orchestrates NIP-43 membership writes (including the non-empty-members guard against re-adding removed members) and only reads the allowlist. Both reviewers independently concluded moving it would conflate the auth gate with membership policy.
  • E2E at head on fresh Postgres: moved allowlist test 1/1; an ephemeral black-box probe of Db::backfill_from_allowlist() passed (hex conversion, member role, community scoping, non-empty guard); relay_members::tests:: 9/10 with the single failure being a known pre-existing ownership-transfer mismatch that predates this stack; cargo check -p buzz-relay passes.

MINOR (non-blocking): a third copy of the setup_db/make_community Postgres test helpers now exists across module test mods (same note left on #6782). A shared #[cfg(test)] helper module as a stack-wide follow-up would remove the duplication.

@TheSentinel454
TheSentinel454 force-pushed the codex/issue-12-allowlist-store branch from 7ae63f6 to 95eb593 Compare August 27, 2026 20:07
Signed-off-by: OpenAI Codex <codex@openai.com>
@TheSentinel454

Copy link
Copy Markdown
Contributor Author

🤖 Superseded by #6987, which consolidates the remaining issue #2 store-extraction stack onto merged #6782. #6987 is an open draft at the independently reviewed exact head, and all exact-head CI checks are green. This PR remains available for review history; please continue review on #6987.

TheSentinel454 added a commit that referenced this pull request Aug 28, 2026
## Summary

Finish the remaining database-store extraction tracked by
[TheSentinel454#2](TheSentinel454#2)
in one reviewable PR.

This consolidates the previously stacked domain slices after #6782
merged. It preserves the runtime/store boundary established by #6660,
#6668, #6700, and #6782 while separating database runtime infrastructure
from domain-owned persistence:

- `runtime/` owns pool construction and sizing, writer/reader routing,
read sessions and route proofs, transaction infrastructure,
observability primitives, replica fencing, health support, migrations,
and cross-cutting runtime tests.
- `store/` owns domain records, SQL, row parsing, locks and invariants,
`Db` domain methods, focused tests, and logical-operation datastore
spans.
- `lib.rs` remains a 57-line compatibility facade that preserves
existing crate-root paths and `Db` method signatures through re-exports.

Domain coverage includes API tokens, authentication allowlists,
reminders, event queries, threads, reactions, feeds, users and DMs,
push, workflows/runs/approvals, relay membership and invites, product
feedback, moderation/admin moderation, relay admin actions/operators,
git repositories, archived identities, usage, partition maintenance,
deletion, channel membership inherited from merged #6782, and the final
runtime/store layout.

The branch has been rebased onto current `main`. Database changes that
landed there were incorporated rather than overwritten:
`relay_admin_actions.rs` and `relay_operators.rs` now live under
`store/`, their 27 public `Db` wrappers and existing behavior remain
intact, and every wrapper has exactly one fixed-name datastore span.
Concurrent changes to migration, moderation, admin moderation, and error
handling are also retained.

### Exact base and head

- Base: `main` at `ed11c8d8bf0a17402be5cf243724f89471530d2f`
- Head: `codex/issue-2-store-extraction` at
`be24430472d1a87ac5c0d6026c620cd6caea3537`

### Related issue

- Structural tracker:
[TheSentinel454#2](TheSentinel454#2)
- Domain trackers:
[#6](TheSentinel454#6),
[#7](TheSentinel454#7),
[#12](TheSentinel454#12),
[#13](TheSentinel454#13)
- Acceptance trackers:
[#17](TheSentinel454#17),
[#19](TheSentinel454#19)

This supersedes #6783, #6784, #6787, #6788, #6789, #6792, #6820, #6794,
#6796, #6797, #6798, #6799, #6804, #6805, #6806, #6808, #6809, #6811,
#6812, #6813, #6814, #6815, and #6890. Their discussions remain
available for review history.

### #17 / #19 acceptance

- Preserves the metric names, fixed labels, transaction/lock timing
boundaries, and privacy/cardinality constraints introduced by #6700.
- Keeps exactly one datastore span per public logical operation,
including the 27 relay-admin wrappers added on `main`.
- Removes `store_ownership.rs`; physical ownership and focused source
guards now enforce the boundary directly.
- Leaves no `impl Db`, domain SQL, focused domain test group, or
datastore span in `lib.rs`.
- Preserves existing public paths such as `buzz_db::channel`,
`buzz_db::event`, and `buzz_db::workflow` through crate-root re-exports
while keeping internal `runtime` and `store` namespaces private.

### Non-goals

- No SQL, schema, locking, transaction, retry, timeout, or
client-visible behavior changes.
- No generic store traits, domain handles, broad `PgExecutor` migration,
new store crate, raw pool accessor, or broader directory reorganization.
- No tracker issues are closed by this PR.

### Risk

The cumulative diff is large but structural. Risk is primarily
module-path, ownership, or conflict-resolution drift. It is mitigated by
preserving public re-exports, comparing the newly moved `main`
implementations to their upstream source, source guards, touched-crate
compilation, PostgreSQL-backed test coverage, and an independent
exact-head review on a separate clean Blox workstation.

### Testing

Author workstation `buzz-tornquist-pr-6987-rebase`, rebased branch
ending at exact head `be24430472d1a87ac5c0d6026c620cd6caea3537`:

- `cargo fmt --all --check`
- `cargo clippy -p buzz-db -p buzz-relay --all-targets -- -D warnings`
- `cargo test -p buzz-db --lib` — 113 passed, 240 PostgreSQL tests
intentionally ignored
- `cargo test -p buzz-db --test observability_source` — 2 passed
- PostgreSQL-backed `buzz-db` coverage under native PostgreSQL — 235
passed in the shared serial run; the five shared-state/config-sensitive
cases passed as isolated reruns against fresh schemas, including the two
owner-limit tests with their fixture's
`BUZZ_MAX_COMMUNITIES_PER_OWNER=3`
- `cargo test -p buzz-relay --lib -- --test-threads=1` under native
PostgreSQL/Redis — 991 passed; the three current-month
partition-sensitive identity-archive cases passed after provisioning the
August 2026 test partition; 87 infrastructure-marked tests remained
ignored
- Source/diff guards — relay-admin implementation bodies match current
`main`; all 27 public wrapper signatures are retained; exactly one
datastore span wraps each wrapper; `lib.rs` has zero `impl Db` blocks
and zero datastore spans; no duplicate top-level relay-admin modules or
`store_ownership.rs`; `error.rs` matches current `main`

Independent clean review workstation `buzz-tornquist-pr-6987-review`,
detached at exact head `be24430472d1a87ac5c0d6026c620cd6caea3537`:

- `cargo fmt --all --check`
- `cargo clippy -p buzz-db -p buzz-relay --all-targets -- -D warnings`
- `cargo test -p buzz-db --lib` — 113 passed, 240 ignored
- `cargo test -p buzz-db --test observability_source` — 2 passed
- Exact-head ownership/re-export/instrumentation audit — no remaining
actionable findings

---------

Signed-off-by: OpenAI Codex <codex@openai.com>
Signed-off-by: tornquist <tornquist@squareup.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants