Social Activity Recognition on Continuous RGB-D Video Sequences

Coppola, Claudio and Cosar, Serhan and Faria, Diego R. and Bellotto, Nicola (2019) Social Activity Recognition on Continuous RGB-D Video Sequences. International Journal of Social Robotics . ISSN 1875-4791

Documents
Social Activity Recognition on Continuous RGB-D Video Sequences
author's accepted manuscript

Request a copy
[img] PDF
Journal_Paper__Journal_Social_Robotics___V2_.pdf - Whole Document
Restricted to Repository staff only

3MB
Item Type:Article
Item Status:Live Archive

Abstract

Modern service robots are provided with one or more sensors, often including RGB-D cameras, to perceive objects and humans in the environment. This paper proposes a new system for the recognition of human social activities from a continuous stream of RGB-D data. Many of the works until now have succeeded in recognising activities from clipped videos in datasets, but for robotic applications it is important to be able to move to more realistic scenarios in which such activities are not manually selected. For this reason, it is useful to detect the time intervals when humans are performing social activities, the recognition of which can contribute to trigger human-robot interactions or to detect situations of potential danger. The main contributions of this research work include a novel system for the recognition of social activities from continuous RGB-D data, combining temporal segmentation and classification, as well as a model for learning the proximity-based priors of the social activities. A new public dataset with RGB-D videos of social and individual activities is also provided and used for evaluating the proposed solutions. The results show the good performance of the system in recognising social activities from continuous RGB-D data.

Keywords:activity recognition, robotics, computer vision
Subjects:G Mathematical and Computer Sciences > G740 Computer Vision
G Mathematical and Computer Sciences > G760 Machine Learning
G Mathematical and Computer Sciences > G700 Artificial Intelligence
H Engineering > H671 Robotics
Divisions:College of Science > School of Computer Science
ID Code:35151
Deposited On:14 Mar 2019 16:05

Repository Staff Only: item control page