System design

• How to implement a distributed and auto-scalable WebSocket server architecture on Kubernetes

  • how to find a sender id if it is not found locally

    • Pub/Sub solution (can be expensive)

    • rendezvous hashing taking instance_ids (from K8s API) and sender_id (looks better)

  • how to load balance WebSocket re/connections

    • least_connection algorithm to balance connections to new instances

    • clients may need to be able to reestablish WebSocket connections