Towards automated system and experiment reproduction in robotics

Lier, Florian and Hanheide, Marc and Natale, Lorenzo and Schulz, Simon and Weisz, Jonathan and Wachsmuth, Sven and Wrede, Sebastian (2016) Towards automated system and experiment reproduction in robotics. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 9 - 14 October 2016, Daejeon, Korea.

0882.pdf - Whole Document



Even though research on autonomous robots and
human-robot interaction accomplished great progress in recent
years, and reusable soft- and hardware components are
available, many of the reported findings are only hardly
reproducible by fellow scientists. Usually, reproducibility is
impeded because required information, such as the specification
of software versions and their configuration, required data sets,
and experiment protocols are not mentioned or referenced
in most publications. In order to address these issues, we
recently introduced an integrated tool chain and its underlying
development process to facilitate reproducibility in robotics.
In this contribution we instantiate the complete tool chain in
a unique user study in order to assess its applicability and
usability. To this end, we chose three different robotic systems
from independent institutions and modeled them in our tool
chain, including three exemplary experiments. Subsequently,
we asked twelve researchers to reproduce one of the formerly
unknown systems and the associated experiment. We show that
all twelve scientists were able to replicate a formerly unknown
robotics experiment using our tool chain.

Item Type:Conference or Workshop contribution (Paper)
Keywords:robotics, software engineering
Subjects:H Engineering > H671 Robotics
G Mathematical and Computer Sciences > G600 Software Engineering
Divisions:College of Science > School of Computer Science
ID Code:24852
Deposited By: Marc Hanheide
Deposited On:26 Oct 2016 08:23
Last Modified:26 Oct 2016 08:23

Repository Staff Only: item control page