Show HN: TurboPrefill – Multi-GPU prefill acceleration for llama.cpp

github.com/sergey-automation

2 points

trykhlieb

19 days ago

TurboPrefill is an attempt to make layer-split multi-GPU configurations spend less time waiting and more time computing during prefill.