[BUG] Hotbar replenish exceeding 90 Inventorypackets upon sorting inventory when re-starting paver

[Faye-one]

Describe the bug
When restocking and having items in the wrong order in hotbar or in the upper inventory slots and activating the paver, it sorts items too fast, exceeding the packet limit.

Screenshot / video
https://medal.tv/games/minecraft/clips/l8aRnaJvnfxcVBksS?invite=cr-MSw1aU4sNDMxMTgxNDE4

Expected behavior
It sorts the inventory without getting me kicked

Reproducing highwaybuilder bug
Sadly no log here and it does not always happen upon rejoining.

Additional context
I suspect it MIGHT be connected to inventory syncing. Im not sure when syncs happen but if there is a sync right after starting and replenish moves items at the same time, this could cause super high inventory packets.