Skip to content

skip input files #1330

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

skip input files #1330

wants to merge 6 commits into from

Conversation

bertsky
Copy link
Collaborator

@bertsky bertsky commented May 7, 2025

This is a case of not seeing the forest for the trees: In the v3 changes, we did introduce MissingInputFile exception (for OCRD_MISSING_INPUT=ABORT). But that only applied narrowly: iff there is no mets:file in one of the input fileGrps.

However, the more important case seems to be that there is a mets:file (regardless of the number of input fileGrps), but it is not available locally, and OCRD_DOWNLOAD_INPUT=False was set deliberately – to either trigger OCRD_MISSING_INPUT=ABORT or OCRD_MISSING_INPUT=SKIP.

But we did not implement this case yet – instead, we let the function proceed without download, which will then fail (without the SKIP behaviour) at page_from_file.

So now the ABORT and SKIP behaviours are enforced for locally missing files, too.

@bertsky bertsky requested a review from kba May 7, 2025 23:08
@bertsky
Copy link
Collaborator Author

bertsky commented May 21, 2025

I don't understand what's going on with the network integration tests...

… Timer to distinguish page timeouts from actual KeyboardInterrupt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant