Skip to content

Conversation

@aelkiss
Copy link
Member

@aelkiss aelkiss commented Dec 10, 2025

This is desirable when for example we are loading a new members' holdings, one type passes validation, but another doesn't; if we then fix the one that failed, we get the complaint about type mismatch (since only one type of data was loaded before).

This is also potentially an issue when formats do change and we want to manually back up, delete, and then reload. Again, when loading new data, we can run into this problem if some passes the validation & we load it but other data doesn't.

Longer-term, we should think about:

  • by default, loading data only if all submitted files are valid (ETT-1193)
  • being able to specify a particular file to scrub & load when needed (ETT-1194)
  • automating the reload process when formats change (ETT-253)

This is desirable when for example we are loading a new members'
holdings, one type passes validation, but another doesn't; if we then
fix the one that failed, we get the complaint about type mismatch (since
only one type of data was loaded before).

This is also potentially an issue when formats do change and we want to
manually back up, delete, and then reload. Again, when loading new data, we can
run into this problem if some passes the validation & we load it but
other data doesn't.

Longer-term, we should think about:

* by default, loading data only if *all* submitted files are valid
* being able to specify a particular file to scrub & load when needed
* automating the reload process when formats change (ETT-253)
@coveralls
Copy link

Coverage Status

coverage: 77.25% (+0.01%) from 77.24%
when pulling f922c09 on ETT-1178-skip-type-checker
into a8e7a48 on main.

@aelkiss aelkiss requested a review from liseli December 10, 2025 19:45
@aelkiss
Copy link
Member Author

aelkiss commented Dec 10, 2025

@liseli I've run into the problem this addresses both on ETT-1178 and ETT-1164, see comments there for more motivation of the issue

Copy link
Contributor

@liseli liseli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These changes seem fine to me

@moseshll
Copy link
Contributor

Ditto Lianet's comment. This will definitely be helpful.

@aelkiss aelkiss merged commit a85e34f into main Dec 10, 2025
1 check passed
@aelkiss aelkiss deleted the ETT-1178-skip-type-checker branch December 10, 2025 22:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants