Supervised autonomy for online learning in human-robot interaction

Senft, Emmanuel and Baxter, Paul and Kennedy, James and Lemaignan, Severin and Belpaeme, Tony (2017) Supervised autonomy for online learning in human-robot interaction. Pattern Recognition Letters, 96 . pp. 77-86. ISSN 0167-8655

Documents
17 PatRecLet Emmanuel.pdf
[img]
[Download]
[img]
Preview
PDF
17 PatRecLet Emmanuel.pdf - Whole Document

643kB
Item Type:Article
Item Status:Live Archive

Abstract

When a robot is learning it needs to explore its environment and how its environment responds on its
actions. When the environment is large and there are a large number of possible actions the robot can
take, this exploration phase can take prohibitively long. However, exploration can often be optimised
by letting a human expert guide the robot during its learning. Interactive machine learning, in which a
human user interactively guides the robot as it learns, has been shown to be an effective way to teach a
robot. It requires an intuitive control mechanism to allow the human expert to provide feedback on
the robot’s progress. This paper presents a novel method which combines Reinforcement Learning
and Supervised Progressively Autonomous Robot Competencies (SPARC). By allowing the user to
fully control the robot and by treating rewards as implicit, SPARC aims to learn an action policy
while maintaining human supervisory oversight of the robot’s behaviour. This method is evaluated and
compared to Interactive Reinforcement Learning in a robot teaching task. Qualitative and quantitative
results indicate that SPARC allows for safer and faster learning by the robot, whilst not placing a high
workload on the human teacher.

Keywords:SPARC, Learning from demonstration, Human-robot interaction, online learning, supervised robot autonomy, interactive reinforcement learning
Subjects:G Mathematical and Computer Sciences > G700 Artificial Intelligence
G Mathematical and Computer Sciences > G440 Human-computer Interaction
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:26857
Deposited On:28 Mar 2017 19:30

Repository Staff Only: item control page