About me
I am currently a Senior Researcher at Tencent, Shenzhen, China. Previously, I completed my Ph.D. (2021) and B.S. (2016) in Computer Science at Tsinghua University, advised by Prof. Guangwen Yang.
During my doctoral studies, I conducted research internships at Microsoft Research Asia from 2016 to 2019, where I was first advised by Dr. Lintao Zhang (2016-2018) and later by Dr. Tao Qin and Dr. Li Zhao (2018-2019). Additionally, I worked as a Visiting Student Researcher at Stanford University from 2020 to 2021, advised by Prof. Tengyu Ma.
My research interests include AI agents, deep reinforcement learning, causal inference, data science and their commercial applications.
Publications
(* represents equal contribution)
Revisiting Discrete Soft Actor-Critic
Haibin Zhou, Tong Wei, Zichuan Lin, Junyou Li, Deheng Ye, Qiang Fu, Wei Yang
TMLR 2024CurrMask: Learning Versatile Skills with Automatic Masking Curricula
Zhihui Xie, Yao Tang, Zichuan Lin, Deheng Ye, Shuai Li
NeurIPS 2024Replay-enhanced Continual Reinforcement Learning
Tiantian Zhang, Kevin Z. Shen, Zichuan Lin, Bo Yuan, Xueqian Wang, Xiu Li, Deheng Ye
TMLR 2023A Survey on Transformers in Reinforcement Learning
Wenzhe Li*, Hao Luo*, Zichuan Lin*, Chongjie Zhang, Zongqing Lu, Deheng Ye
TMLR 2023Future-conditioned Unsupervised Pretraining for Decision Transformer
Zhihui Xie, Zichuan Lin, Deheng Ye, Qiang Fu, Wei Yang, Shuai Li
ICML 2023Dynamics-Adaptive Continual Reinforcement Learning via Progressive Contextualization
Tiantian Zhang, Zichuan Lin, Yuxing Wang, Deheng Ye, Qiang Fu, Wei Yang, Xueqian Wang, Bin Liang, Bo Yuan, Xiu Li
TNNLS 2023Pretraining in Deep Reinforcement Learning: A Survey
Zhihui Xie, Zichuan Lin, Junyou Li, Shuai Li, Deheng Ye
arxiv 2022JueWu-MC: Playing Minecraft with Sample-efficient Hierarchical Reinforcement Learning
Zichuan Lin*, Junyou Li*, Jianing Shi*, Deheng Ye, Qiang Fu, Wei Yang
IJCAI 2022 (Long Oral top3%) (The champion solution of NeurIPS 2021 MineRL research competition)Joint System-Wise Optimization for Pipeline Goal-Oriented Dialog System
Zichuan Lin, Jing Huang, Bowen Zhou, Xiaodong He, Tengyu Ma
arxiv 2021Model-based Adversarial Meta-Reinforcement Learning [code]
Zichuan Lin, Garrett Thomas, Guangwen Yang, Tengyu Ma
NeurIPS 2020RD$^2$: Reward Decomposition with Representation Decomposition
Zichuan Lin*, Derek Yang*, Li Zhao, Tao Qin, Guangwen Yang, Tie-yan Liu
NeurIPS 2020Episodic Reinforcement Learning with Associative Memory
Guangxiang Zhu*, Zichuan Lin*, Guangwen Yang, and Chongjie Zhang
ICLR 2020Object-Oriented Dynamics Learning through Multi-Level Abstraction
Guangxiang Zhu*, Jianhao Wang*, Zhizhou Ren*, Zichuan Lin and Chongjie Zhang
AAAI 2020Distributional Reward Decomposition for Reinforcement Learning
Zichuan Lin, Li Zhao, Derek Yang, Tao Qin, Guangwen Yang, and Tie-yan Liu
NeurIPS 2019Fully Parameterized Quantile Function for Distributional Reinforcement Learning [code]
Derek Yang, Li Zhao, Zichuan Lin, Jiang Bian, Tao Qin, and Tie-yan Liu
NeurIPS 2019Unified Policy Optimization for Robust Reinforcement Learning
Zichuan Lin, Li Zhao, Jiang Bian, Tao Qin, and Guangwen Yang
ACML 2019 (Oral)Episodic Memory Deep Q-Networks [code]
Zichuan Lin, Tianqi Zhao, Guangwen Yang, and Lintao Zhang
IJCAI 2018
Talks
JueWu-MC: Playing Minecraft with Sample-efficient Hierarchical Reinforcement Learning
IJCAI, Long Oral, 2022Model-based Adversarial Meta-Reinforcement Learning
ICML, BIG Workshop, 2020Unified Policy Optimization for Reinforcement Learning [slides]
Nagoya, Japan, 2019Towards Sample-efficient, Interpretable and Robust Reinforcement Learning [slides]
Wuxi, China, 2019Episodic Memory Deep Q-Networks [slides]
Stockholm, Sweden, 2018Reinforcement Learning: Episodic Memory and Learning to Run [slides]
MSRA, Beijing, 2017
Awards & Honors
- Beijing Outstanding PhD Graduate, 2021.
- 84 Innovative Future Scholarship (Top 1%) at department of Computer Science at Tsinghua University, 2020.
- National Scholarship (Top 1%) at Tsinghua University, 2020.
- Person of the Year nominee, Tsinghua University, 2019. [Media Coverage]
- Tsinghua Scholarship for Overseas Graduate Study, 2019.
- Excellence in the Microsoft Research Asia Internship Program, 2018. [Media Coverage]
- WeChat Public Account Article, Tsinghua University, 2018. [Media Coverage]
- National Scholarship (Top 1%) at Tsinghua University, 2018.
- Top 10 Outstanding Athletes at Tsinghua University, 2017. [Media Coverage]
- Excellent Undergraduate Thesis Award (Top 10%) at Tsinghua University, 2016.
- Top 2 in Tsinghua Mathematical Contest in Modeling, 2016.
- 1st Place in College Table Tennis Student Championships in Beijing, 2013-2016.
- Table Tennis National First-Level Athlete, 2012.
- 1st Place in World Table Tennis Student Championships, Liaoning, China, 2011.