Splitting Up Services

  • How do we split traffic between two servers?
  • You can use another component called a "Load Balancer"
  • Maybe split traffic in a round-robin pattern?
  • Maybe send requests to the server who has the shortest request queue?
  • Maybe split traffic by percentage weightings if servers are different sizes?
  • Only send traffic to healthy servers
  • How is the load balancer not a single point of failure?

8 / 18