My core research interests lie in large-scale machine learning and machine learning system. I co-design algorithm and system, aiming to scale-up and/or accerlate machine learning models. Some examples include LLM KV Cache quantization, randomized matrix mulplication, and GNN quantization. Besides MLsys, I am also interested in other core problems/applications in LLMs like RAG, long context ability, and LLM safety.