Hi there π
I am a Ph.D. student in Computer Science at the University of California, Santa Barbara (UCSB), advised by Prof. Zheng Zhang. Before that I received my B.Eng. in Microelectronics from the Southern University of Science and Technology (SUSTech), advised by Prof. Hao Yu.
My research focuses on efficient large language models, including quantization, sparsification and low-rank decomposition for faster training and inference, together with optimizer design (the Muon family) for LLM pre-training. I also enjoy bridging machine learning and hardware, from GPU/FPGA kernels to compiler co-design for edge AI.
I am actively looking for internship opportunities, either during the summer or the semester. Feel free to reach out at yupengsu@ucsb.edu.
News
- 2026.07 π Our papers MuonQ and RankGuide are accepted by CoLM 2026.
- 2025.07 π Our paper LLM-Barber is accepted by IEEE/ACM ICCAD 2025.
- 2025.05 π Our paper EdgeLLM is accepted by IEEE TCAS-I: Regular Papers.
- 2025.02 π I have been admitted to the PhD program at the University of California, Santa Barbara (UCSB)!
- 2024.09 π€ Joined the HKU Next Gen AI (NGai) Lab as a Student RA, collaborating with PolyU Prof. Hongxia Yangβs Lab.
- 2024.02 π Our paper APTQ is accepted by IEEE/ACM DAC 2024.
Publications
citations240β indicates first-author work.
-
β MuonQ: Enhancing Low-Bit Muon Quantization via Directional Fidelity Optimization
-
RankGuide: Tensor-Rank-Guided Routing and Steering for Efficient Reasoning
-
MuonΒ²: Boosting Muon via Adaptive Second-Moment Preconditioning
-
MUON+: Towards More Effective Muon via One Additional Normalization Step for LLM Pre-training
-
TEON: Tensorized Orthonormalization Beyond Layer-Wise Muon for Large Language Model Pre-Training
-
APTQ+: Attention-FFN-aware Post-Training Quantization for a Layer-wise LLM Accelerator on FPGA
-
β LLM-Barber: Block-Aware Rebuilder for Sparsity Mask in One-Shot for Large Language Models
-
PTQTP: Post-Training Quantization to Trit-Planes for Large Language Models
-
EdgeLLM: A Highly Efficient CPU-FPGA Heterogeneous Edge Accelerator for Large Language Models
-
APTQ: Attention-Aware Post-Training Mixed-Precision Quantization for Large Language Models
Projects
Education & Experience
π Education
π» Experience
Honors & Awards
- 2025.07Nominee of Top Ten Graduates, Southern University of Science and Technology.
- 2025.07Guo Xie Birong Scholarship for Academic Excellence, SUSTech.
- 2025.06Top Ten Graduates of the College of Engineering, SUSTech.
- 2022β2024First-Class Merit Student Scholarship (three consecutive years), SUSTech.
- 2023.12Future Star, Ministry of Education β Huawei Smart Base Project.