About
I make large language models cheaper to train, to serve, and to run as agents.
I am a Ph.D. student in Computer Science at the University of California, Santa Barbara (UCSB), advised by Prof. Zheng Zhang. Before that I received my B.Eng. in Microelectronics from the Southern University of Science and Technology (SUSTech), advised by Prof. Hao Yu.
My research is on efficient large language models: the Muon optimizer family and its low-bit states for pre-training, quantization and sparsity for inference, and the context that long-horizon agents carry. I also enjoy bridging machine learning and hardware, from GPU/FPGA kernels to compiler co-design for edge AI.
I am actively looking for 2027 research internships on efficient LLM training, inference and agents (summer or during the semester). Feel free to reach out at yupengsu@ucsb.edu.
News
- 2026.08 🎉 Our paper Muon² is accepted by EMNLP 2026 as an Oral presentation.
- 2026.07 🎉 Our papers MuonQ and RankGuide are accepted by COLM 2026.
- 2025.07 🎉 Our paper LLM-Barber is accepted by IEEE/ACM ICCAD 2025.
- 2025.05 🎉 Our paper EdgeLLM is accepted by IEEE TCAS-I: Regular Papers.
- 2025.02 🎓 I have been admitted to the PhD program at the University of California, Santa Barbara (UCSB)!
- 2024.09 🤝 Joined the HKU Next Gen AI (NGai) Lab as a Student RA, collaborating with PolyU Prof. Hongxia Yang’s Lab.
- 2024.02 🎉 Our paper APTQ is accepted by IEEE/ACM DAC 2024.
Publications
citations245★ first author·* equal contribution
- arXiv 2026 ReFold
- COLM 2026 MuonQ
- ICCAD 2025 LLMBarber
- COLM 2026
- EMNLP 2026
- arXiv 2026
- arXiv 2026
- TCAD 2026
- arXiv 2025
- arXiv 2025
- TCAS-I 2025
- DAC 2024
Education & Experience
🎓 Education
💻 Experience
Earlier projects
Honors & Awards
- 2025.07Nominee of Top Ten Graduates, Southern University of Science and Technology.
- 2025.07Guo Xie Birong Scholarship for Academic Excellence, SUSTech.
- 2025.06Top Ten Graduates of the College of Engineering, SUSTech.
- 2022–2024First-Class Merit Student Scholarship (three consecutive years), SUSTech.
- 2023.12Future Star, Ministry of Education – Huawei Smart Base Project.