Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recovery from errors on the new scheduler for Git #646

Open
sduenas opened this issue Apr 1, 2024 · 0 comments
Open

Recovery from errors on the new scheduler for Git #646

sduenas opened this issue Apr 1, 2024 · 0 comments

Comments

@sduenas
Copy link
Member

sduenas commented Apr 1, 2024

The current scheduler - sirmordred - is not able to recover from errors. The only way to do it is manually (normally restarting the scheduler). There are some situations when this is even harder. For git, to be sure data wasn't lost, the user will have to remove the last git repository that was being analyzed from the perceval cache.

The goal is to add support on the new scheduler to recover from these type of errors. For this, the possible scenarios are:

  • The code that fetches data fails
  • The scheduler is shutdown manually while fetching data
  • The scheduler shutdowns unexpectedly

This will be a common objective for the scheduler but, since we're starting to work only with Git data, this task is only related to that datasource.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Near Term
Development

No branches or pull requests

1 participant