Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[client] Introduce AdminApiDriver for workflows which lookup broker first then send request. #479

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

loserwang1024
Copy link
Collaborator

Purpose

Linked issue: close #288

Inspired by https://issues.apache.org/jira/browse/KAFKA-12609, which introduce AdminApiDriver do theses things:

  • Retry lookup stage on receiving NOT_LEADER_OR_FOLLOWER and LEADER_NOT_AVAILABLE, whereas in the past we failed the partition directly without retry.

  • retry fulfillment stage on RetriableException

Tests

  • AdminApiDriverTest for AdminApiDriver
  • com.alibaba.fluss.client.admin.FlussAdminITCase#testListOffsets for Admin#ListOffsets

API and Format

Some internal interface:

  • AdminApiDriver
  • AdminApiHandler
  • AdminApiFuture
  • AdminApiLookupBrokerIdStrategy

Documentation

@loserwang1024 loserwang1024 requested review from wuchong, swuferhong, leonardBang and luoyuxia and removed request for wuchong February 25, 2025 02:33
@loserwang1024
Copy link
Collaborator Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] New Partiions created will cause Flink job failover when partition discovery is enabled while scanning
1 participant