Add support for data deduplication on catalog consolidation

[ms32035]

Pull Request

NautilusTrader prioritizes correctness and reliability, please follow existing patterns for validation and testing.

• [ X] I have reviewed the CONTRIBUTING.md and followed the established practices

Summary

An additional parameter to support data deduplication that could have occurred due to using skip_disjoint_check

Related Issues/PRs

Type of change

• Bug fix (non-breaking)
• New feature (non-breaking)
• Breaking change (impacts existing behavior)
• Documentation update
• Maintenance / chore

Breaking change details (if applicable)

Documentation

• Documentation changes follow the style guide (docs/developer_guide/docs.md)

Release notes

• I added a concise entry to RELEASES.md that follows the existing conventions (when applicable)

Testing

Ensure new or changed logic is covered by tests.

• Affected code paths are already covered by the test suite
• I added/updated tests to cover new or changed logic

[cjdsellers]

Hi @ms32035

When you get a chance could you please rebase on latest develop. There's a more robust CI installation routine which will overcome the current fails.

[cjdsellers]

Thanks for the contribution @ms32035 🙏