Show HN: Open-source load balancer for llama.cppgithub.com/distantmagic151 pointsmcharytoniuk2 years agoStateful load balancer customized for llama.cpp (with a reverse proxy).