System design ยท HTTP, APIs & networking
Put a routing layer in front of workers
A load balancer distributes incoming connections or requests across healthy backends. It can prevent any one instance from receiving all traffic and provide a stable entry point as instances are added or removed.
It is itself a dependency: plan redundancy, capacity, and health visibility for the routing layer.