Complementary Visual Neuronal Systems Model for Collision Sensing

Fu, Qinbing and Yue, Shigang (2020) Complementary Visual Neuronal Systems Model for Collision Sensing. In: The IEEE International Conference on Advanced Robotics and Mechatronics (ARM), 18-21, December, 2020, Shenzhen, China.

Full content URL:

Complementary Visual Neuronal Systems Model for Collision Sensing
Authors' Accepted Manuscript
Q.Fu_ARM_2020.pdf - Whole Document

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


Inspired by insects’ visual brains, this paper presents original modelling of a complementary visual neuronal systems model for real-time and robust collision sensing. Two categories of wide-field motion sensitive neurons, i.e., the lobula giant movement detectors (LGMDs) in locusts and the lobula plate tangential cells (LPTCs) in flies, have been studied, intensively. The LGMDs have specific selectivity to approaching objects in depth that threaten collision; whilst the LPTCs are only sensitive to translating objects in horizontal and vertical directions. Though each has been modelled and applied in various visual scenes including robot scenarios, little has been done on investigating their complementary functionality and selectivity when functioning together. To fill this vacancy, we introduce a hybrid model combining two LGMDs (LGMD-1 and LGMD2) with horizontally (rightward and leftward) sensitive LPTCs (LPTC-R and LPTC-L) specialising in fast collision perception. With coordination and competition between different activated neurons, the proximity feature by frontal approaching stimuli can be largely sharpened up by suppressing translating and receding motions. The proposed method has been implemented ingroundmicro-mobile robots as embedded systems. The multi-robot experiments have demonstrated the effectiveness and robustness of the proposed model for frontal collision sensing, which outperforms previous single-type neuron computation methods against translating interference.

Keywords:complementary visual system, neuron system model, multiple motion cues, motion perception, bio-robotics
Subjects:G Mathematical and Computer Sciences > G400 Computer Science
Divisions:College of Science > School of Computer Science
ID Code:42134
Deposited On:21 Oct 2020 13:29

Repository Staff Only: item control page