On: When Simple Wins: Power of 2 Load Balancing

[adrianN]

When the number of server changes you slowly ramp up from mod n to mod (n+1). Flip a biased coin for each user to decide whether to use n or n+1, slowly crank up the bias to the n+1 side.