Exploring the Potential and Limitations of Learning-Based Robotics
Robot control traditionally involves modelling the internal dynamics of a robot and optimising its behaviour based on that model. In recent years, however, machine learning has increasingly been used to dynamically learn such models. At the same time, machine learning is not limited to robotics; it is also widely used for a broad range of tasks, including data mining and recommender systems. As a result, many machine learning methods are designed with generality in mind.
Consequently, machine-learning-based robot control has limitations when dealing with fine-grained situations in the real world. To overcome these limitations, it is necessary to build optimised intelligence that can solve a wider range of problems with simpler mechanisms, while also actively intervening in the environment to reduce complexity.
Through our research, we aim to extend the capabilities of current robots to the real world and design systems that allow them to fully realise their potential.
Specific Research Activities in Our Laboratory
Path Planning for Multiple Robots and Smart Mobility
Safe Route Optimisation for Multiple Vessels
Our laboratory investigates route planning algorithms for multiple vessels using distributional reinforcement learning (DRL). Specifically, by combining DRL with the Obstacle Zone by Target (OZT) proposed by the National Maritime Research Institute, we have developed a method that enables vessels to learn actions that avoid collision risks based on predictions of vessel motion, thereby supporting safe navigation. Our future goals are to develop algorithms that can be applied to more advanced simulations and to construct learning algorithms that take into account real-world effects that cannot be ignored, such as wind.
Route Optimisation for Multiple Aerial Delivery Robots
Japan's working-age population has continued to decline in recent years. In the transportation sector, where the impact is particularly severe, securing labour through the introduction of robots and autonomous driving technologies has become an urgent issue. In collaboration with Assistant Professor Ding at Kyoto University, Mr Aoyama at Panasonic Holdings Corporation, and Associate Professor Hayashi at Okayama University, our laboratory investigates route optimisation algorithms for aerial delivery drones. Specifically, we train drone policies in simulations that reproduce dynamic factors in aerial delivery, such as route blockages and control instability caused by wind, and develop methods that enable safe transportation even in real-world environments. Our laboratory also jointly organises the Delivery Robot Routing Problems Challenge (DRP Challenge) every year to explore better algorithms.
Multi-Objective Path Optimisation and Control for Multiple Robots
Solving real-world problems often requires handling multiple tasks, whereas AI systems are typically designed to achieve a single objective. For example, an image recognition AI aims to identify objects in an input image. However, when such recognition is applied to autonomous driving, various other objectives must also be considered, such as collision avoidance and reaching a destination. The same issue arises in multi-agent reinforcement learning.
Our laboratory addresses these limitations and investigates ways to solve real-world problems using multi-objective AI. Specifically, we improve algorithms for multi-objective multi-agent path planning and multi-objective multi-agent reinforcement learning so that they can be trained with a practical amount of learning for real-world applications.
Robot Control in Unknown Environments
Knowledge Generation and Evolution in Intelligent Robots
For autonomous mobile robots, self-localisation and path planning are essential. SLAM (Simultaneous Localisation and Mapping) is a key technology for this purpose, but discrepancies between input information and spatial relationships can cause serious problems. Our laboratory focuses on perceptual aliasing, in which different situations are incorrectly recognised as the same due to incomplete perceptual information, and works on resolving such cognitive discrepancies by drawing on insights from neuroscience.
In particular, our faculty member has worked with Professor Will N. Browne at Queensland University of Technology to improve the performance of XCS Classifier Systems, an evolutionary machine learning method, and to apply them to robot navigation.
Robots operating in real-world environments require flexible control that can adapt to uncertainty. However, AI methods, including reinforcement learning, are fundamentally designed to become intelligent through experience, which means that they often struggle with situations they have not previously encountered. Our laboratory investigates reinforcement learning methods for enabling such flexibility in field robots.
Self-Localisation Algorithms for Planetary Explorers
In the past, our faculty member investigated self-localisation algorithms for a lunar lander in the SLIM (Smart Lander for Investigating Moon) project launched by JAXA. One of the main pillars of this project was the demonstration of pinpoint landing technology based on real-time trajectory correction using image matching navigation. As the term image matching suggests, the method estimates the lander's position by matching crater patterns in lunar surface images with a pre-loaded crater map and measuring the deviation from the planned trajectory. In the self-localisation method to which our faculty member contributed, triangles are first formed from craters and matched as shown below. Then, based on the matched triangles, outlier craters are matched, and the lander's position is calculated from the coordinates of the matched craters.
Although the SLIM mission has already been completed, our laboratory continues to work on remaining challenges and aims to address them using AI-based approaches.