I am an Assistant Researcher in College of Computer Science & Software Engineering at Hohai University. I obtained my Ph.D. degree from Department of Computer Science & Technology in Nanjing University in Dec. 2022, where I was very fortunate to be advised by Prof. Zhi-Hua Zhou. Before that, I received my B.Sc. degree from Department of Statistics in University of Science and Technology of China in Jun. 2017.
My research interest includes ensemble learning and learning theory.
[Resume] & [中文简历]
🔥 News
- Enrolling Students: Looking for self-motivated M.Sc students to work on Artificial Intelligence.
Feel free to send me an email with your resume and a document stating your research motivation. - 2024.05: 🎉🎉 Our paper “Confidence-Aware Contrastive Learning for Selective Classification” is accepted by the CCF-A international conference ICML 2024.
- 2023.12: 🎉🎉 My doctoral dissertation “Research on Theoretical Analysis of Deep Forests and Extensions” was awarded the Excellent Doctoral Dissertation of Jiangsu Association of Artificial Intelligence.
- 2022.12: 🎉🎉 Our paper “Depth is More Powerful than Width with Prediction Concatenation in Deep Forests” is accepted by the CCF-A international conference NeurIPS 2022 as an Oral Presentation.
- 2019.12: 🎉🎉 Our paper “A Refined Margin Distribution Analysis for Forest Representation Learning” is accepted by the CCF-A international conference NeurIPS 2019.
👨💻 Students
M.Eng Students
2023: [Tian-Shuang Wu 吴填双] (Co-supervised with Baoliu Ye); [Ning Chen 陈宁] (Co-supervised with Bin Tang);
2024: [Jia-Le Xu 许佳乐] (Co-supervised with Bin Tang);
B.Eng Students
2024:
Collected Seminars
[ML&DM Seminar]: Seminar on Machine Learning and Data Mining for my students.
[FAI Seminar]: International Seminar on Foundational Artificial Intelligence.
📝 Publications
-
[ICLR 2025] Offline Model-Based Optimization by Learning to Rank. [paper] [bib]
Rong-Xi Tan, Ke Xue, Shen-Huan Lyu, Haopu Shang, Yao Wang, Yaoyuan Wang, Sheng Fu, and Chao Qian
In: Proceedings of the 13th International Conference on Learning Representations, in press, 2025. -
[PRICAI 2024] Personalized Federated Learning with Feature Alignment via Knowledge Distillation. [paper] [bib]
Guangfei Qi, Zhihao Qu, Shen-Huan Lyu, Ninghui Jia, and Baoliu Ye.
In: Proceedings of the 21st Pacific Rim International Conference on Artificial Intelligence, pp. 121-133, Kyoto, Japan, 2024. (CCF C) -
[ECAI 2024] The Role of Depth, Width, and Tree Size in Expressiveness of Deep Forest. [paper] [code] [bib]
Shen-Huan Lyu*, Jin-Hui Wu*, Qin-Cheng Zheng, and Baoliu Ye. (* indicates equal contribution)
In: Proceedings of the 27th European Conference on Artificial Intelligence, pp. 2042-2049, Santiago de Compostela, Spain, 2024. (CCF B) -
[ECAI 2024] Mask-Encoded Sparsification: Overcoming Biased Gradients for Communication-Efficient Split Learning. [paper] [bib]
Wenxuan Zhou, Zhihao Qu, Shen-Huan Lyu, Miao Cai, and Baoliu Ye.
In: Proceedings of the 27th European Conference on Artificial Intelligence, pp. 2806-2813, Santiago de Compostela, Spain, 2024. (CCF B)
- [INS 2024] Multi-Class Imbalance Problem: A Multi-Objective Solution. [paper] [code] [bib]
Yi-Xiao He, Dan-Xuan Liu, Shen-Huan Lyu, Chao Qian, and Zhi-Hua Zhou.
Information Sciences, 680:121156, 2024. (CCF B, CAS Q1)
- [ICML 2024] Confidence-Aware Contrastive Learning for Selective Classification. [paper] [code] [bib]
Yu-Chang Wu, Shen-Huan Lyu, Haopu Shang, Xiangyu Wang, and Chao Qian.
In: Proceedings of the 41st International Conference on Machine Learning, pp. 53706-53729, Vienna, Austria, 2024. (CCF A)
-
[IWQoS 2024] Identifying Key Tag Distribution in Large-Scale RFID Systems. [paper] [bib]
Yanyan Wang, Jia Liu, Shen-Huan Lyu, Zhihao Qu, Bin Tang, and Baoliu Ye.
In: Proceedings of the 32nd IEEE/ACM International Symposium on Quality of Service, pp. 1-10, Guangzhou, China, 2024. (CCF B) -
[TKDD 2024] Interpreting Deep Forest through Feature Contribution and MDI Feature Importance. [paper] [code] [bib]
Yi-Xiao He, Shen-Huan Lyu, and Yuan Jiang.
ACM Transactions on Knowledge Discovery from Data, in press, 2024. (CCF B, CAS Q3) -
[JOS 2024] Interaction Representations Based Deep Forest Method in Multi-Label Learning. [paper] [bib]
Shen-Huan Lyu, Yi-He Chen, and Yuan Jiang.
Journal of Software, 35(4):1934-1944, 2024. (CCF A in Chinese) -
[AISTATS 2023] On the Consistency Rate of Decision Tree Learning Algorithms. [paper] [code] [bib]
Qin-Cheng Zheng, Shen-Huan Lyu, Shao-Qun Zhang, Yuan Jiang, and Zhi-Hua Zhou.
In: Proceedings of the 26th International Conference on Artificial Intelligence and Statistics, pp. 7824-7848, Valencia, ES, 2023. (CCF C)
- [NeurIPS 2022 Oral] Depth is More Powerful than Width with Prediction Concatenation in Deep Forests. [paper] [bib]
Shen-Huan Lyu, Yi-Xiao He, and Zhi-Hua Zhou.
In: Advances in Neural Information Processing Systems 35, pp. 29719-29732, New Orleans, Louisiana, US, 2022. (CCF A)
- [NEUNET 2022] Improving Generalization of Neural Networks by Leveraging Margin Distribution. [paper] [code] [bib]
Shen-Huan Lyu, Lu Wang, and Zhi-Hua Zhou.
Neural Networks, 151:48-60, 2022. (CCF B, CAS Q1)
-
[CJE 2022] A Region-Based Analysis for the Feature Concatenation in Deep Forests. [paper] [bib]
Shen-Huan Lyu, Yi-He Chen, and Zhi-Hua Zhou.
Chinese Journal of Electronics, 31(6):1072-1080, 2022. (CCF A in Chinese, CAS Q4) -
[ICDM 2021] Improving Deep Forest by Exploiting High-Order Interactions. [paper] [code] [bib]
Yi-He Chen*, Shen-Huan Lyu*, and Yuan Jiang. (* indicates equal contribution)
In: Proceedings of the 21st IEEE International Conference on Data Mining, pp. 1030-1035, Auckland, NZ, 2021. (CCF B)
- [NeurIPS 2019] A Refined Margin Distribution Analysis for Forest Representation Learning. [paper] [code] [bib]
Shen-Huan Lyu, Liang Yang, and Zhi-Hua Zhou.
In: Advances in Neural Information Processing Systems 32, pp. 5531-5541, Vancouver, British Columbia, CA, 2019. (CCF A)
🎖 Honors and Awards
- 2024.09 The Hong Kong Scholars Program, China.
- 2024.07 Jiangsu Youth Science and Technology Talent Sponsorship Program, Jiangsu.
- 2023.12 Excellent Doctoral Dissertation of Jiangsu Artificial Intelligence Society, Jiangsu.
- 2023.06 The 5th Special Funding from China Postdoctoral Science Foundation, China.
- 2022.12 Jiangsu Excellent Postdoctoral Program, Jiangsu.
- 2019.10 Artificial Intelligence Scholarship in Nanjing University, Nanjing.
- 2019.09 The First Class Academic Scholarship in Nanjing University, Nanjing.
- 2018.09 The First Class Academic Scholarship in Nanjing University, Nanjing.
- 2017.09 Presidential Special Scholarship for first year Ph.D. Student in Nanjing University, Nanjing.
- 2016.09 The Silver Prize Scholarship for Excellent Student in University of Science and Technology of China, Hefei.
✨ Academic Service
Senior Program Committee Member of Conferences:
- IJCAI: 2021
Program Committee Member of Conferences:
- ICML: 2021-2024
- NeurIPS: 2020-2024
- AAAI: 2020, 2021, 2023
- IJCAI: 2020, 2022-2024
- ICLR: 2020-2025
- AISTATS: 2023-2025
Reviewer for Journals:
- Artificial Intelligence (AIJ)
- IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
- IEEE Transactions on Knowledge and Data Engineering (TKDE)
- IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
- ACM Transactions on Knowledge Discovery from Data (TKDD)
- Machine Learning (MLJ)
- Research
- Chinese Journal of Electronics (CJE)
- 软件学报 (Journal of Software, JOS)
📖 Educations
- 2017.09 - 2022.12, Ph.D. in Computer Science, Nanjing University (NJU)
- 2013.09 - 2017.06, B.Sc. in Statistics, University of Science and Technology of China (USTC)
💬 Invited Talks
- 2023.11, Deep Forest, Z-Park National Laboratory, Beijing.
- 2022.12, Depth is More Powerful than Width, New Orleans Convention Center, Online.
- 2022.01, Margin Distribution Neural Networks, Huawei Noah’s Ark Lab, Online.
💻 Experiences
- 2022.12 - now, Assistent Researcher in Hohai University, Nanjing.
- 2022.06 - 2022.08, Machine Learning Engineer in Huawei Noah’s Ark Lab, Nanjing.