Kvcached: Virtualized, elastic KV cache for LLM serving on shared GPUsnotion.so69 pointsJrxing8 months agohttps://github.com/ovg-project/kvcached