Action Conditioned Tactile Prediction: a case study on slip prediction

Mandil, Willow, Nazari, Kiyanoush and Ghalamzan E., Amir (2022) Action Conditioned Tactile Prediction: a case study on slip prediction. In: Robotics: Science and Systems, June 27–July 1, 2022, New York City, USA.

Full content URL:

Action Conditioned Tactile Prediction: a case study on slip prediction
Action_Conditioned_Tactile_Prediction_for_Robot_Manipulation_RSS (2).pdf - Whole Document

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


Tactile predictive models can be useful across several robotic manipulation tasks, e.g. robotic pushing, robotic grasping, slip avoidance, and in-hand manipulation. However, available tactile prediction models are mostly studied for image-based tactile sensors and there is no comparison study indicating the best performing models. In this paper, we presented two novel data-driven action-conditioned models for predicting tactile signals during real-world physical robot interaction tasks (1) action condition tactile prediction and (2) action conditioned tactile-video prediction models. We use a magnetic-based tactile sensor that is challenging to analyse and test state-of-the-art predictive models and the only existing bespoke tactile prediction model. We compare the performance of these models with those of our proposed models. We perform the comparison study using our novel tactile-enabled dataset containing 51,000 tactile frames of a real-world robotic manipulation task with 11 flat-surfaced household objects. Our experimental results demonstrate the superiority of our proposed tactile prediction models in terms of qualitative, quantitative and slip prediction scores.

Keywords:Robotics, Tactile perception, data-driven modelling
Subjects:H Engineering > H671 Robotics
Divisions:College of Science > Lincoln Institute for Agri-Food Technology
ID Code:51691
Deposited On:14 Sep 2022 13:05

Repository Staff Only: item control page