We can add a Load balancing layer at three places in our system:
- Between Clients and Application servers
- Between Application Servers and database servers
- Between Application Servers and Cache servers
Why do we need load balancer in 2 and 3 above? Won’t the load balancer already be built into the nosql db and distributed cache?