feat(pubsub): implement publish hedging to reduce tail latency - #13735

Merged

tonyyyycui merged 49 commits into

googleapis:mainfrom

tonyyyycui:publish-hedging-settings

Sep 14, 2026

Commits on Jul 13, 2026

Add hedgeSettings with configurable hedgeDelay
Tony Cui
committed
61d0b60
Add HedgeTokenBucket class to allow for token operations
Tony Cui
committed
19afd68
Add publisher integration with HedgeSettings
Tony Cui
committed
49426a9
Restore original @Ignore annotations and code in PublisherImplTest
Tony Cui
committed
22417d1
style(pubsub): fix checkstyle violations in HedgeSettings
Tony Cui
committed
91706a2
style(pubsub): fix formatting and checkstyle violations in HedgeSettings and tests
Tony Cui
committed
bd76ede
Merge branch 'main' into publish-hedging-settings
tonyyyycui
authored
61aef08

Commits on Jul 20, 2026

Resolve git comments related to access modifiers and constraints
Tony Cui
committed
227f808
Add CancellationSharer and HedgedRequest helper classes
Tony Cui
committed
e29eab8
Integrate CancellationSharer and HedgedRequest into Publisher.java. Also add Unit tests
Tony Cui
committed
ed05c60
fix lint
Tony Cui
committed
23b8432
Modifying comment line
Tony Cui
committed
3a23d60

Commits on Jul 27, 2026

Modified default values, added configurable settings to refill ratio and maxtokens, updated tests.
Tony Cui
committed
da4307e
Removed HedgeTokenBucket.java class in favor of using an atomicinteger for hedgeTokenBucket. Also added HEDGE_TOKEN_SCALE.
Tony Cui
committed
336c809
Add documentation for scaling and remove unused getAttemptCount() in CancellationSharer.java
Tony Cui
committed
59a7a09
Added method overloading to handle OTel span for hedged publish events
Tony Cui
committed
79411a8
Verify that the per-RPC timeout is strictly greater than the hedging delay
Tony Cui
committed
e545cd6
Moved static methods in Publisher.java above the builder
Tony Cui
committed
8543d23
Configure empty token bucket and fix naming
Tony Cui
committed
3c48a1a
Change from synchronization to actual lock object for processQueue method
Tony Cui
committed
0929a1b

Commits on Jul 28, 2026

Add header injection for hedged publish requests
Tony Cui
committed
0295144
Cleanup code and fix bug with handling failure attempts in the first rpc call
Tony Cui
committed
c8296f5
Disable retries for failing rpcs when publish hedging
Tony Cui
committed
c8fd6e9

Commits on Jul 30, 2026

Change how cancellationSharer propagates cancellations for different failure codes
Tony Cui
committed
0b88e33
Fixing race condition in unit test setup
Tony Cui
committed
b6af015
Merge branch 'main' into publish-hedging-settings
tonyyyycui
authored
be69b98

Commits on Jul 31, 2026

Modify header to use an integer count instead of a bool
Tony Cui
committed
1a4644f
Merge branch 'publish-hedging-settings' of github.com:tonyyyycui/google-cloud-java into publish-hedging-settings
Tony Cui
committed
e87c26f
Fix lint
Tony Cui
committed
dd288c7

Commits on Aug 4, 2026

Modify scale factor and minimum refillRatio value. Add test annotation to publisher
Tony Cui
committed
8885dc2
Update scale factor, refill ratio constraints, and simplify token bucket operations
Tony Cui
committed
2eb687f
Rename HedgeSettings to HedgingSettings
Tony Cui
committed
100db18
Inline the hedging attempt count headers map creation
Tony Cui
committed
ba05985
Added new subsystem to loggerUtil and adjusted logging usage
Tony Cui
committed
97820e7
Add debugging for token bucket rate limiting
Tony Cui
committed
58a4f70
Add publish end (hedged) event as well
Tony Cui
committed
7361f15
Add synchronized locking to resolve race condition in cancellationsharer
Tony Cui
committed
52a7cb3

Commits on Aug 5, 2026

Clean up unused memory
Tony Cui
committed
5320a56
Set deadlineMs for hedged requests
Tony Cui
committed
747e11e
Optimize processQueue() by setting threads free earlier
Tony Cui
committed
73f61a2
Move hedgingSettings check
Tony Cui
committed
ecd4ef7

Commits on Aug 19, 2026

Fixed small bugs and renaming nits
Tony Cui
committed
e0a20c2
Remove redundant code
Tony Cui
committed
a9bd384
Import new files into librarian.yaml
Tony Cui
committed
ab78c53
Modfied hedging publish start and end events in OTel spans
Tony Cui
committed
2519a90

Commits on Aug 20, 2026

Fix lint
Tony Cui
committed
35bd4e6

Commits on Aug 24, 2026

Fix up comments regarding callbacks, tests, and spans
Tony Cui
committed
41a54ab

Commits on Sep 1, 2026

Add Math.round() to fix floats`
Tony Cui
committed
3785482

Commits on Sep 10, 2026

address review feedback related to concurrency
Tony Cui
committed
8d50837