I will also add my 5 cents.

1. More complex implementation
2. How will it handle noisy neghbor issue, all the requests will be mapped to the same server.
3. Snow ball crash effect - if one server fails, lets say too many heavy requests, they will all go to the next which already have its own which can now also crash. now requwsts from s1 and s2 all sent to s3