Add an in memory request cache of responses to avoid sending a lot of requests to other servers shortly after each other. Basically could have two components: 1. Cache for destination URLs and their response 2. Cache for UUID to URL mapping
Add an in memory request cache of responses to avoid sending a lot of requests to other servers shortly after each other.
Basically could have two components: