News

About Me

I am currently working as a postdoctoral fellow at University of Waterloo and Vector Institute with Prof. Pascal Poupart.

Research Interests: Reinforcement Learning (RL), including Model-based RL, Interpretable RL, Agent Evaluation and Embedding. I have also studied RL applications on Natural Language Process (NLP), Sports analytic and Autonomous Driving

Education: I received my Ph.D. degree at the School of Computing Science, Simon Fraser University under the supervision of Prof. Oliver Schulte. I have finished a research internships at Cognitive Computing Lab, Baidu Research (supervised by Prof. Ping Li). I received my Bachelor degree at the School of Computing Science and Engineering, South China University of Technology.

For my full cv, please visit here(Updated 2022)

Preprints

• Uncertainty-Aware Reinforcement Learning for Risk-Sensitive Player Evaluation in Sports Game.
  Guiliang Liu, Yudong Luo, Pascal Poupart, Oliver Schulte.
• Benchmarking Constraint Inference in Inverse Reinforcement Learning.
  Guiliang Liu, Yudong Luo, Ashish Gaurav, Kasra Rezaee, Pascal Poupart.
• Learning Soft Constraints From Constrained Expert Demonstrations.
  Ashish Gaurav, Kasra Rezaee, Guiliang Liu, Pascal Poupart.
• NTS-NOTEARS: Learning Nonparametric Temporal DAGs With Time-Series Data and Prior Knowledge.
  Xiangyu Sun, Guiliang Liu, Pascal Poupart, Oliver Schulte.

Selected Publications

• Learning Object-Oriented Dynamics for Planning from Text.
  Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart.
  International Conference on Learning Representations (ICLR) 2022
  [Paper (PDF)], [Slides], [Code],
• Distributional Reinforcement Learning with Monotonic Splines.
  Yudong Luo, Guiliang Liu, Haonan Duan, Oliver Schulte, Pascal Poupart.
  International Conference on Learning Representations (ICLR) 2022
  [Paper (PDF)], [Code],
• Learning Tree Interpretation from Object Representation for Deep Reinforcement Learning.
  Guiliang Liu, Xiangyu Sun, Oliver Schulte, Pascal Poupart.
  Advances in Neural Information Processing Systems (Neurips) 2021.
  [Paper (PDF)], [Slides], [Code],
• Learning Agent Representations for Ice Hockey.
  Guiliang Liu, Oliver Schulte, Pascal Poupart, Mike Rudd, Mehrsan Javan.
  Advances in Neural Information Processing Systems (Neurips) 2020.
  [Paper (PDF)], [Slides], [Video], [Code ],
• An Advantage Actor-Critic Algorithm with Confidence Exploration for Open Information Extraction.
  Guiliang Liu, Xu Li, Mingming Sun, Ping Li.
  SIAM International Conference on Data Mining (SDM) 2020.
  [Paper (PDF)]
• Extracting Knowledge from Web Text with Monte Carlo Tree Search.
  Guiliang Liu, Xu Li, Jiakang Wang, Mingming Sun, Ping Li.
  The ACM Web Conference (WWW) 2020.
  [Paper (PDF)], [Slides]
• Cracking the Black Box: Distilling Deep Sports Analytics.
  Xiangyu Sun, Jack Davis, Oliver Schulte, Guiliang Liu.
  SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) 2020.
  [Paper (PDF)], [arXiv], [Slides], [ Video], [Code]
• Deep soccer analytics: Learning an action-value function for evaluating soccer players.
  Guiliang Liu, Yudong Luo, Oliver Schulte, and Tarak Kharrat.
  ECML-PKDD 2020 Journal Track, published at Data Mining and Knowledge Discovery (DMKD).
  [Paper (PDF)], [Slides],
• Deep Reinforcement Learning in Ice Hockey for Context-Aware Player Evaluation.
  Guiliang Liu, Oliver Schulte.
  International Joint Conference on Artificial Intelligence (IJCAI) 2018.
  [Paper (PDF)], [arXiv], [Code], [Slides],
• Toward Interpretable Deep Reinforcement Learning with Linear Model U-Trees.
  Guiliang Liu, Oliver Schulte, Wang Zhu,
  European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Database (ECML-PKDD) 2018.
  [Paper (PDF)], [arXiv], [Slides],

Services

Conference Reviewer: Neurips, ICML, ICLR, AAAI, UAI.
Journal Reviewer: Pattern Recognition, Artificial Intelligence, Data Mining and Knowledge Discovery.

Contact

Email: g233liu[at]uwaterloo[dot]ca
Address: Davis Centre, University of Waterloo, Waterloo, Canada
Linkedin: Guiliang (Galen) Liu