Mooncake: Trading More Storage for Less Computation - A KVCache-centric Architecture for Serving LLM Chatbot.

Ruoyu Qin, Zheming Li, Weiran He, Jialei Cui, Feng Ren,Mingxing Zhang,Yongwei Wu,Weimin Zheng, Xinran Xu

USENIX Conference on File and Storage Technologies（2025）

Cited 0|Views6

AI Read Science

Must-Reading Tree

Example

Generate MRT to find the research sequence of this paper

Chat Paper

Summary is being generated by the instructions you defined