Skip to content

Automate database backup verification and disaster-recovery drills - #168

Open
nwosum113-ui wants to merge 2 commits into
EF-CHAIN:mainfrom
nwosum113-ui:issue162
Open

Automate database backup verification and disaster-recovery drills#168
nwosum113-ui wants to merge 2 commits into
EF-CHAIN:mainfrom
nwosum113-ui:issue162

Conversation

@nwosum113-ui

Copy link
Copy Markdown
Contributor

Summary

Automates database restore verification process to ensure backup reliability and reduce manual intervention.

Changes

  • Introduces GitHub Actions workflow for automated restore drill execution
  • Adds verification script to validate database restore operations
  • Updates documentation with workflow details and background processes
  • Modifies API dependencies to support new automation features
  • Includes test suite for restore drill verification

Impact

  • Reliability: Automates critical backup verification step
  • CI/CD: New workflow runs on schedule and PR triggers
  • Testing: Enhanced test coverage for restore operations
  • Docs: Updated operational documentation for restore processes

closes #162

…p-validation-process

Add automated restore verification drill (workflow, verifier, docs, tests)
@vercel

vercel Bot commented Aug 20, 2026

Copy link
Copy Markdown

@nwosum113-ui is attempting to deploy a commit to the ezedikeevan's projects Team on Vercel.

A member of the Team first needs to authorize it.

@Gozirimdev Gozirimdev left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the work here. Before we can merge, please:

  • Measure RTO from the start of the restore, not only the validation step.
  • Make Redis/queue recovery required and verify the oldest job age.
  • Confirm the restored backup matches the reported backup metadata.
  • Replace the eval-based restore and teardown commands with fixed, safe scripts and block production targets.
  • Add tests for these failure and teardown paths.

Once these are covered, we can re-review.

@Gozirimdev Gozirimdev left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI is failing, and the restore drill still needs safe fixed commands, production-target protection, full RTO measurement, backup metadata verification, and required Redis recovery checks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Automate database backup verification and disaster-recovery drills

2 participants