Department of Electrical Engineering and Automation

Maps of Dynamics

Change and motion are inherent features of reality. Thus, the assumption that only static parts of the environment are worth maintaining substantially limits the information available to robots. Therefore, we focus on exploring methods to capture, represent, and maintain accurate spatio-temporal models of dynamic environments.
MoD_eps
Different types of changes (dynamics) that are relevant with respect to robot maps.

To achieve the smooth, safe, and reliable operation of robots in proximity to humans, it is essential to enable robots to behave in a predictable, safe, and legible manner while adhering to common social norms. This requires robots to understand and follow general patterns governing the flow of people, ensuring socially acceptable behaviour, and anticipating human actions, thereby ensuring safe and efficient operation.

Over the past three decades, there has been significant progress in the development of human motion prediction algorithms, which allow robots to anticipate human actions in the near future. This capability enables robots to proactively avoid collisions, facilitating smooth and safe interactions between humans and robots. Additionally, recent years have seen rapid advancements in Maps of Dynamics (MoD), which capture global motion patterns governing human behaviour in specific environments. Although these two areas address different aspects of the same problem, they are still awaiting proper integration to fully utilize MoD in conjunction with motion prediction algorithms.

In this project, we aim to develop a novel framework that utilizes robotics mapping and representation learning techniques to address the modelling of dynamic aspects and human motion prediction problems. By collecting and modelling real-world pedestrian data, a long-term human motion prediction in environments with limited data access will be accomplished.

Keywords: 

Machine Learning; Deep Learning; Spatial Models of Dynamics; Human-Motion Prediction. 

People involved:

Publications

Survey of maps of dynamics for mobile robots

Tomasz Piotr Kucner, Martin Magnusson, Sariah Mghames, Francesco Verdoja, Chittaranjan Srinivas Swaminathan, Tomáš Krajník, Erik Schaffernicht, Nicola Bellotto, Marc Hanheide, Achim J Lilienthal 2023 The International Journal of Robotics Research

Learning State-Space Models for Mapping Spatial Motion Patterns

Junyi Shi, Tomasz Piotr Kucner 2023 European Conference on Mobile Robots (ECMR)

CLiFF-LHMP: Using Spatial Dynamics Patterns for Long-Term Human Motion Prediction

Yufei Zhu, Andrey Rudenko, Tomasz P Kucner, Luigi Palmieri, Kai O Arras, Achim J Lilienthal, Martin Magnusson 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

THOR-Magni: Comparative Analysis of Deep Learning Models for Role-Conditioned Human Motion Prediction

Tiago Rodrigues De Almeida, Andrey Rudenko, Tim Schreiter, Yufei Zhu, Eduardo Gutierrez Maestro, Lucas Morillo-Mendez, Tomasz P Kucner, Oscar Martinez Mozos, Martin Magnusson, Luigi Palmieri, Kai O Arras, Achim J Lilienthal 2023 Proceedings of the IEEE/CVF International Conference on Computer Vision

Benchmarking the utility of maps of dynamics for human-aware motion planning

Chittaranjan Srinivas Swaminathan, Tomasz Piotr Kucner, Martin Magnusson, Luigi Palmieri, Sergi Molina, Anna Mannucci, Federico Pecora, Achim J Lilienthal 2022 Frontiers in Robotics and AI
  • Published:
  • Updated: