We should investigate and implement some mechanism for rejecting all the invalid (nonce too low / nonce too high transactions) EVM transactions on the EVM Gateway level, before they even get submitted to the Flow network.
Although the resulting transactions are quite cheap in computation, as they fail early, they still do incur some Flow fees for EVM node operators.