Efficient Heterogeneous Large Language Model Decoding with Model-Attention Disaggregation

Shaoyuan Chen, Wencong Xiao, Yutong Lin,Mingxing Zhang,Yingdi Shan, Jinlei Jiang,Kang Chen,Yongwei Wu

CoRR（2024）

Cited 9|Views388

AI Read Science

Must-Reading Tree

Example

Generate MRT to find the research sequence of this paper

Chat Paper

Summary is being generated by the instructions you defined