Learned graphical models for probabilistic planning provide a new class of movement primitives

Rueckert, Elmar A., Neumann, Gerhard, Toussaint, Marc and Maass, Wolfgang (2013) Learned graphical models for probabilistic planning provide a new class of movement primitives. Frontiers in Computational Neuroscience, 6 . ISSN 1662-5188

Full content URL: https://doi.org/10.3389/fncom.2012.00097

pubmed-zip/versions/1/fncom-06-00097.pdf - Whole Document
Available under License Creative Commons Attribution.

Item Type:Article
Item Status:Live Archive


Biological movement generation combines three interesting aspects: its modular organization in movement primitives (MPs), its characteristics of stochastic optimality under perturbations, and its efficiency in terms of learning. A common approach to motor skill learning is to endow the primitives with dynamical systems. Here, the parameters of the primitive indirectly define the shape of a reference trajectory. We propose an alternative MP representation based on probabilistic inference in learned graphical models with new and interesting properties that complies with salient features of biological movement control. Instead of endowing the primitives with dynamical systems, we propose to endow MPs with an intrinsic probabilistic planning system, integrating the power of stochastic optimal control (SOC) methods within a MP. The parameterization of the primitive is a graphical model that represents the dynamics and intrinsic cost function such that inference in this graphical model yields the control policy. We parameterize the intrinsic cost function using task-relevant features, such as the importance of passing through certain via-points. The system dynamics as well as intrinsic cost function parameters are learned in a reinforcement learning (RL) setting. We evaluate our approach on a complex 4-link balancing task. Our experiments show that our movement representation facilitates learning significantly and leads to better generalization to new task settings without re-learning.

Keywords:Movement Primitives
Subjects:H Engineering > H671 Robotics
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:25789
Deposited On:28 Jul 2017 08:35

Repository Staff Only: item control page