Biography

Kyle Hollins Wray is a Director of Engineering at Robust AI. He leads the creation of autonomous robots that can plan, make decisions, navigate, and coordinate in the real world. He also researches theoretical models and practical algorithms for decision-making under uncertainty in real robots. Previously, Kyle was a Principal Researcher at the Nissan Advanced Technology Center - Silicon Valley where he led the creation of autonomous vehicle decision-making systems and hybrid electric vehicle energy management systems. He was also a Visiting Scholar at Stanford University working with Mykel Kochenderfer where he co-authored a textbook entitled Algorithms for Decision Making that was published by MIT Press.

He earned his doctorate in computer science from the University of Massachusetts Amherst, advised by Shlomo Zilberstein, specializing in artificial intelligence and autonomous robots. Kyle earned his bachelor's and master's degrees in computer science, engineering, and mathematics from the University of Massachusetts Amherst and The Pennsylvania State University.

He is the recipient of the ICAPS Best Dissertation Award (2020), the runner-up Victor Lesser Distinguished Dissertation Award (2020), the Nissan Patent Research Award (2020 and 2018), and the Outstanding Graduate Research Award (2016).

He serves as an Associate Editor for IEEE Robotics and Automation Letters (RA-L) and an Area Chair for AAAI Conference on Artificial Intelligence (AAAI).

Please see his curriculum vitae (CV) for more details.

Academic Research Interests

Kyle’s research interests include decision-making, modeling, planning, and learning in the fields of both artificial intelligence and robotics. His work spans the design and analysis of theoretical models, the creation of efficient algorithms, and the practical applications of these decision-making approaches.

In artificial intelligence, he is particularly interested in the theoretical foundations of decision-making models based on MDPs, SSPs, POMDPs, and Dec-POMDP. In particular, he designs novel multi-objective and hierarchical models that unify prior models, and proposes scalable algorithms that solve them.

In robotics, he is particularly interested the goal of true long-term autonomy. In particular, he designs novel MDPs, SSPs, POMDPs, and Dec-POMDPs, with efficient algorithms to solve them online, that enable scalability, are robust, and provide safety guarantees.

His models and algorithms are deployed on Robust AI’s collaborative mobile robots and Nissan’s autonomous vehicles.

News

2024

March

March

February

February

  • Our ICRA 2024 paper on a highly performant Constrained POMDP (CPOMDP) online solver!

February

  • Another six U.S. patents were granted.

2023

June

June

  • In the past ten months, fourteen new patents were granted (nine U.S. and five international)!

April

March

2022

August

  • I am now a Director of Engineering at Robust AI leading the teams within Planning and Optimization.

June

  • Our paper on computing multi-objective policy gradients in Topological MDPs (TMDPs), and a resulting extension to PPO, has been accepted to IROS 2022.

May

  • Our paper on an improved Lexicographic SSP (LSSP) algorithm has been accepted to SoCS 2022.

April

  • Four more U.S. patents on autonomous vehicle decision-making were granted!

January

  • Our ICRA 2022 paper on an CPOMDP fast-converging gradient ascent algorithm that uses an approximate constraint projection was accepted!

January

2021

November

  • I am now a principal researcher at Nissan!

September

  • I am now also a visiting scholar at Stanford!

September

  • Eight more patents have been granted for autonomous vehicles!

June

  • Our paper on improved competence via state space refinement was accepted to IROS 2021!

April

  • Our paper on a new series hybrid vehicle intelligent engine activation algorithm, which is based on multi-objective SSPs, was accepted to IEEE's top intelligent vehicles/transportation conference IEEE IV 2021!

March

  • Two more patents have been granted for autonomous vehicles.

February

  • Our paper on a novel scalable class of finite state controllers, called circulant controllers, was accepted to ICRA 2021!

January

  • Two more patents have been granted for autonomous vehicles.

January

  • Our paper on the MODIA autonomous vehicle architecture was accepted to IEEE ISR 2021!

2020

November

  • Both a U.S. and an E.U. patent were granted for autonomous vehicles.

August

  • I am the primary inventor on ten more international patent applications for autonomous vehicles.

July

June

May

  • Two U.S. patents were granted for autonomous vehicles!

April

  • I am now a senior researcher at Nissan.

March

January

  • Our conference paper on learning competence in semi-autonomous systems was accepted to AAMAS 2020!

2019

November

  • I am the primary inventor on seven more international patent applications for autonomous vehicles.

June

  • I started working at Nissan’s Alliance Innovation Lab Silicon Valley full-time!

June

  • Two IROS 2019 papers were accepted on autonomous vehicle introspection and goal uncertainty in stochastic shortest path problems!

May

  • I have officially graduated with my doctorate in computer science!

March

  • I have successfully defended my dissertation: Abstractions in Reasoning for Long-Term Autonomy!

January

  • Our paper on generalized controllers for POMDPs was accepted to ICRA 2019! It generalizes popular approximate POMDP policy forms used in point-based, FSC, and compression algorithms under one unified controller family form.

January

  • Our AAMAS 2019 paper on policy networks was accepted as an extended abstract. It generalizes many popular models of hierarchies and multiple objectives, such as CMDPs and the options framework, as well as unifying much of my research. For an extensive presentation of policy networks, please read my dissertation later this year!

2018

October

June

  • I have been awarded Nissan's Patent Research Award for my work at the Nissan Research Center!

April

  • Our IJCAI 2018 paper on meta-reasoning for determining the optimal stopping point in anytime algorithms. It has another video of the 'epic' library for path planning from our IROS 2016 paper!

January

  • I am the primary inventor on another six international patent applications for autonomous vehicles.

2017

November

  • Our paper on integrating cooperation and competition (Dec-POMDP and POSG) was accepted to AAAI 2018! It has a multi-robot video using a hybrid Dec-POMDP and POSG with stochastic FSC policies!

July

  • A paper on a simple belief point compression technique called a σ-approximation was accepted to IROS 2017. It has an accompanying video of a robot using a POMDP!

May

April

  • Our conference paper on MODIA, which is a method for online scalable decision-making with applications to autonomous vehicles, was accepted to IJCAI 2017!

April

February

  • I am the primary inventor on four international patent applications for autonomous vehicles!

2016

November

November

  • Our AAAI 2017 paper on a short-sighted labeling algorithm for quickly solving SSPs entitled FLARES was accepted.

July

July

  • Our IROS 2016 paper on robot path planning using harmonic functions and GPUs was accepted. This includes the 'epic' library for path planning in ROS.

May

April

January

  • Our AAMAS 2016 paper was accepted as an extended abstract.

2015

December

  • I have passed my qualifying exam with distinction! Now I am a Ph.D. candidate!

November

  • Our AAAI 2016 paper on proactive learning POMDPs has been accepted.

August

  • Both a GPU-based POMDP algorithm paper and a relaxed LMDP paper have been accepted to the SDMIA as part of the AAAI Fall Symposium 2015 Series. The POMDP short paper presents our 'nova' library for planning.

April

  • Our IJCAI 2015 paper on Lexicographic POMDPs has been accepted.

February

2014

November

  • Our AAAI 2015 paper on Lexicographic MDPs has been accepted.

May

  • Two multiagent systems papers have been accepted to the MIPC workshop as part of AAAI 2014.

March

  • I have received the Outstanding Teaching Assistant Award!