Education

• University of Electronic Science and Technology of China (UESTC)

  M.S. in Computer Science & Technology, Sep. 2018 – Jun. 2021

  • Thesis: Transfer reinforcement learning algorithms based on knowledge representation (Accessible Online)

  • Advisor: Prof. William Zhu (Google Scholar)

• University of Electronic Science and Technology of China (UESTC)

  B.E. in Spatial Information & Digital Technology, Sep. 2014 – Jun. 2018

  • Thesis: Research on hyperspectral image classification algorithm based on low-rank model

  • Advisor: Prof. Fen Chen (Google Scholar)

Research Interest

• Reinforcement Learning (RL): Mainly focus on RL in the real world which combines with emerging theories/technologies, including Deep/Transfer/Lifelong/Representation Learning.

• Robotics, Optimal Control: Robot Learning; Model-free, data-driven optimal control methods based on RL theory & approximate/adaptive dynamic programming (ADP).

Skills

• Proficiency in programming, including Python, Matlab, and C/C++.
• Proficient English application skills (IELTS Academic 6.5)
• Solid skills on deep learning frameworks, including PyTorch and Tensorflow.
• Solid artistic and academic writing skills in MS Word and Latex.
• Solid skills in mathematics, statistics, and data analysis.
• Event planning and organizing skills.

Research Experiences

• Data-driven Intelligent Control (Jul. 2021 – Present)

  • Working as a research assistant at the Center for Robotics of UESTC (directed by Prof. Hong Cheng (Google Scholar)). Cooperating with Dr. Zhinan Peng (Google Scholar) on theoretical research for data-driven, model-free adaptive optimal control design, which is based on RL theories and ADP.

  • Recently, a manuscript related to proposed robust adaptive controller is accepted by The 41st Chinese Control Conference (CCC 2022).

• Value-based Reinforcement Learning (Dec. 2018 – Jun. 2021)

  • Conducted a relatively extensive survey on Deep RL (e.g., Distributional RL, Variants of DQN, Actor-Critic Methods) and Transfer/Lifelong RL. Mainly focused on value-based algorithms.

  • Reproduced QUOTA Algorithm in PyTorch (Github, 125 stars & 18 forks).

  • Codes for experiments in pre-print manuscript related to Lifelong RL are available on Github.

• Unsupervised Learning (Aug. 2018 – Dec. 2018)

  • Conducted a short survey on Clustering. Mainly focused on hierarchical clustering algorithms.

  • Reproduced some algorithms, such as CURE (Matlab, Python), ROCK (Matlab), and Chameleon (Matlab).

Selected Awards

• Oct. 2020 - Graduate Scholarship of UESTC.
• Sep. 2019 - Graduate Scholarship of UESTC.
• Sep. 2018 - Graduate Scholarship of UESTC.
• Jun. 2018 - Excellent Thesis for Bachelor’s Degree of UESTC.
• Sep. 2017 - Undergraduate Scholarship of UESTC.
• Nov. 2016 - Excellent Volunteer in 2nd China College Students’ Entrepreneurship Competition.
• Nov. 2016 - 1st Award in 5th China College Students’ GIS Application Skills Competition.
• Sep. 2016 - LiQian Scholarship of UESTC.

Extracurricular Activity

• Volunteer Works

  • Actively participate in public welfare activities of the university and society.
  • Founder of the Cedar Growth Association of UESTC.
  • In corporation with Career Guidance Centre of UESTC and Shanghai Cedar Public Welfare Foundation.

• Arts & Sports

  • Published a Chinese Poem (Accessible Online).
  • A big fan of table tennis, badminton and music (Rock & Roll, Folk, and Pop).