Chrome Extension
WeChat Mini Program
Use on ChatGLM
VIPCreated with Sketch.

Improving Automatic Parallel Training Via Balanced Memory Workload Optimization

Yujie Wang,Youhe Jiang,Xupeng Miao,Fangcheng Fu,Shenhan Zhu,Xiaonan Nie,Yaofeng Tu,Bin Cui

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING（2024）

Cited 0|Views50
Key words
Parallel processing,Transformers,Computational modeling,Training,Data models,Memory management,Costs,distributed learning,automatic parallelism
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined