routing: allow misson control manager to startup despite errors #10383
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2 tasks
ziggie1984
force-pushed
the
bugfix/fix-mission-control-startup
branch
from
56f5ad6 to
967ee2a
Compare
ziggie1984
force-pushed
the
bugfix/fix-mission-control-startup
branch
from
961c474 to
798ae45
Compare
2 tasks
We now allow the mission control manager to skip over deserializable errors. We cannot repair this these results but we just skip over it so we can startup properly. When fetchAll() encounters entries that fail to deserialize, in addition to skipping them, now also: - Delete the corrupted entries from the database - Remove them from the in-memory keysMap and keys tracking structures This prevents corrupted entries from: - Being counted toward maxRecords, which would cause valid entries to be pruned prematurely - Persisting in the database indefinitely - Causing inaccurate entry counts in startup logs
ziggie1984
force-pushed
the
bugfix/fix-mission-control-startup
branch
from
798ae45 to
4749b60
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
We now allow the mission control manager to skip over deserializable
errors. We cannot repair this these results but we just skip over
it so we can startup properly. Moreover we also delete those corrupted values.
So we still don't know why it happens so rarely now this problem is fixed anyways because we now validate the ExtraTLVData when receiving a payment error:
Invalid data gets rejected naturally: If a peer sends a ChannelUpdate with malformed ExtraOpaqueData:
- DecodeFailure() fails
- htlcswitch returns UnknownForwardingError (without the ChannelUpdate)
- Mission control stores the failure but without the corrupted ChannelUpdate data
So we basically only have to deal with old data here.