vc5

Best of luck with this. If you get the web hosting part going and need to stick a load balancer in front of web servers/front end proxies, may I suggest that you give my project[1] a go? Speaks BGP directly to your routers to advertise healthy services and scales from small VMs (for services that are only a few gigabits/s) to physical servers if you need to serve tens of gigabits/s traffic. Shameless plug, sorry (not sorry!) but I would have killed for it when I worked in web hosting :-) [1] https://github.com/davidcoles/vc5

Should you wish to give DSR load balancing a go without having to invest in hardware/licenses you could try https://github.com/davidcoles/vc5 Put that in front of some HAProxy servers to do TLS termination and farm out requests to another layer of NGINX/uWSGI boxes and Robert is your cousins father.

Facebook's Katran looked too scary (and I don't do C++), so I thought I would investigate using XDP/eBPF to redirect packets at high speed and Go to do the control plane work of health-checking backed servers and managing configuration. With luck the resulting binary should be easy to deploy by non-developers. It's still not mature, but seems to work. Code was written in a very exploratory manner, and I'm not a developer so it is quite shocking at the moment, but I aim to improve it. It is intended to be horizontally scalable with ECMP and has been tested on service providing 40Gb/s with a single (hardware) node at ~30% CPU utilisation.