Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ground track table update can lead to KeyError in l3.build_dataset #26

Open
j-haacker opened this issue Jun 11, 2024 · 1 comment
Open
Assignees
Labels
bug Something isn't working

Comments

@j-haacker
Copy link
Owner

Describe the bug
KeyError was thrown in l3.build_dataset when continuing gridding cached data chunks after the ground track table was updated.

To Reproduce
Steps to reproduce the behavior:

  1. copy ground tracks to backup, read ground tracks, remove last one or more months of tracks, save the reduced data
  2. delete the cache for some region (data/tmp/<o2-code>), run l3.build_dataset with some future end date
  3. during gridding the cached data chunks exit the function
  4. update the ground tracks or restore backup
  5. continue processing (l3.build_dataset)

Expected behavior
Processing should continue with the old set of data. At least, it should continue in some way, e.g. including the recently added ground tracks, even if that leads to a slightly inconsistent result. At best, it would fill-up the missing time steps of the already-processed chunks and continue for the remaining chunks - resulting in an up-to-date, consistent dataset.

Traceback
not available :/

@j-haacker j-haacker added the bug Something isn't working label Jun 11, 2024
@j-haacker j-haacker self-assigned this Jun 11, 2024
@j-haacker
Copy link
Owner Author

If you encounter this problem, revert the ground track data to the previous version and continue processing. You can easily do so with git checkout <commit hash> data/auxiliary/CryoSat-2_SARIn_ground_tracks.feather (assuming default setup).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant