AI4OPT Seminar Series

Date: Tuesday, October 3, 2023

Time: Noon – 1:00 pm

Location: 9th floor Atrium in Coda Building (756 W Peachtree St NW, Atlanta, GA 30308)

Live streamed Virtually at: https://gatech.zoom.us/j/99381428980

Speaker: Pascal Poupart

Inverse Constraint Learning for Autonomous Driving and Robotics

Abstract: In many applications of reinforcement learning (RL) and control, policies need to satisfy constraints to ensure feasibility, safety or thresholds about key performance indicators.  However, some constraints may be difficult to specify.  For instance, in autonomous driving, it is relatively easy to specify a reward function to reach a destination, but implicit constraints followed by expert human drivers to ensure a safe, smooth and comfortable ride are much more difficult to specify.  I will present some techniques to learn soft constraints from expert trajectories and demonstrate their effectiveness in the context of autonomous driving and robotics. 

The content of this talk will be based on the following papers: 

Ashish Gaurav, Kasra Rezaee, Guiliang Liu, Pascal Poupart (2023) Learning Soft Constraints from Constrained Expert Demonstrations, ICLR.

 Guiliang Liu, Yudong Luo, Ashish Gaurav, Kasra Rezaee, Pascal Poupart (2023) Benchmarking Constraint Inference in Inverse Reinforcement Learning, ICLR.

Bio: Pascal Poupart is a professor in the David R. Cheriton School of Computer Science at the University of Waterloo (Canada). He is also a Canada CIFAR AI Chair at the Vector Institute and a member of the Waterloo AI Institute. He serves on the advisory board of the NSF AI Institute for Advances in Optimization (2022-present) at Georgia Tech. He served as Research Director and Principal Research Scientist at the Waterloo Borealis AI Research Lab at the Royal Bank of Canada (2018-2020). He also served as scientific advisor for ProNavigator (2017-2019), ElementAI (2017-2018) and DialPad (2017-2018). His research focuses on the development of algorithms for Machine Learning with application to Natural Language Processing and Material Design. He is most well-known for his contributions to the development of Reinforcement Learning algorithms. Notable projects that his research team are currently working on include inverse constraint learning, mean field RL, Bayesian federated learning, probabilistic deep learning, conversational agents, automated document editing, sport analytics, adaptive satisfiability and material design for CO2 recycling. 

Lunch will be served at the seminar. So, please stop by 15 minutes before the seminar to pick up lunch.

To continue receiving all AI4OPT seminar announcements, please sign up to the mailing list at:        https://lists.isye.gatech.edu/mailman/listinfo/ai4opt-seminars
Videos of the past seminars can be seen on AI4OPT webpage at:                                                           https://www.ai4opt.org/seminars/past-seminars