Qualitative Prediction of Multi-Agent Spatial Interactions

Mghames, Sariah, Castri, Luca, Hanheide, Marc and Bellotto, Nicola (2023) Qualitative Prediction of Multi-Agent Spatial Interactions. In: 32nd IEEE International Conference on Robot and Human Interactive Communication, 28-31 August, 2023, Busan, South Korea.

Qualitative Prediction of Multi-Agent Spatial Interactions
Author's Accepted Manuscript
[img] PDF
roman23.pdf - Whole Document
Restricted to Repository staff only

Item Type:Conference or Workshop contribution (Presentation)
Item Status:Live Archive


Deploying service robots in our daily life, whether in restaurants, warehouses or hospitals, calls for the need to reason on the interactions happening in dense and dynamic scenes. In this paper, we present and benchmark three new approaches to model and predict multi-agent interactions in dense scenes, including the use of an intuitive qualitative representation. The proposed solutions take into account static and dynamic context to predict individual interactions. They exploit an input- and a temporal-attention mechanism, and are tested on medium and long-term time horizons. The first two approaches integrate different relations from the so-called Qualitative Trajectory Calculus (QTC) within a state-of-the-art deep neural network to create a symbol-driven neural architecture for predicting spatial interactions. The third approach implements a purely data-driven network for motion prediction, the output of which is post-processed to predict QTC spatial interactions. Experimental results on a popular robot dataset of challenging crowded scenarios show that the purely data-driven prediction approach generally outperforms the other two. The three approaches were further evaluated on a different but related human scenarios to assess their generalisation capability.

Keywords:predictive learning, Human-robot interaction
Subjects:G Mathematical and Computer Sciences > G700 Artificial Intelligence
H Engineering > H671 Robotics
G Mathematical and Computer Sciences > G761 Automated Reasoning
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:55466
Deposited On:03 Aug 2023 11:01

Repository Staff Only: item control page