An Empirical Study of Issues in Large Language Model Training Systems
Yanjie Gao, Ruiming Lu, Haoxiang Lin, Yueguo Chen
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
出版物
-
-
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
-
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
-
-
GPU Occupancy Prediction of Deep Learning Models Using Graph Neural Network
Hengquan Mei, Huaizhi Qu, Jingwei Sun, Yanjie Gao, Haoxiang Lin, Guangzhong Sun
CLUSTER 2023 | October 2023
The 25th IEEE International Conference on Cluster Computing
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
-
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
-
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
-
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
-
-
An Empirical Study of Issues in Large Language Model Training Systems
Yanjie Gao, Ruiming Lu, Haoxiang Lin, Yueguo Chen
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
GPU Occupancy Prediction of Deep Learning Models Using Graph Neural Network
Hengquan Mei, Huaizhi Qu, Jingwei Sun, Yanjie Gao, Haoxiang Lin, Guangzhong Sun
CLUSTER 2023 | October 2023
The 25th IEEE International Conference on Cluster Computing
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
-
-
An Empirical Study of Issues in Large Language Model Training Systems
Yanjie Gao, Ruiming Lu, Haoxiang Lin, Yueguo Chen
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
-
-
An Empirical Study of Issues in Large Language Model Training Systems
Yanjie Gao, Ruiming Lu, Haoxiang Lin, Yueguo Chen
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
GPU Occupancy Prediction of Deep Learning Models Using Graph Neural Network
Hengquan Mei, Huaizhi Qu, Jingwei Sun, Yanjie Gao, Haoxiang Lin, Guangzhong Sun
CLUSTER 2023 | October 2023
The 25th IEEE International Conference on Cluster Computing
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
-
-
An Empirical Study of Issues in Large Language Model Training Systems
Yanjie Gao, Ruiming Lu, Haoxiang Lin, Yueguo Chen
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
GPU Occupancy Prediction of Deep Learning Models Using Graph Neural Network
Hengquan Mei, Huaizhi Qu, Jingwei Sun, Yanjie Gao, Haoxiang Lin, Guangzhong Sun
CLUSTER 2023 | October 2023
The 25th IEEE International Conference on Cluster Computing
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
人数
Haoxiang Lin
Principal Researcher
Yanjie Gao
Senior Researcher
Mao Yang
Assistant Managing Director