A multimodal smartphone interface for active perception by visually impaired

Bellotto, Nicola (2013) A multimodal smartphone interface for active perception by visually impaired. In: IEEE SMC Int. Workshop on Human-Machine Systems, Cyborgs and Enhancing Devices (HUMASCEND), 13 Oct 2013, Manchester, UK.

Bellotto2013.pdf - Whole Document

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


The diffuse availability of mobile devices, such as smartphones and tablets, has the potential to bring substantial benefits to the people with sensory impairments. The solution proposed in this paper is part of an ongoing effort to create an accurate obstacle and hazard detector for the visually impaired, which is embedded in a hand-held device. In particular, it presents a proof of concept for a multimodal interface to control the orientation of a smartphone's camera, while being held by a person, using a combination of vocal messages, 3D sounds and vibrations. The solution, which is to be evaluated experimentally by users, will enable further research in the area of active vision with human-in-the-loop, with potential application to mobile assistive devices for indoor navigation of visually impaired people.

Keywords:Mobile assistive technology, human-in-the-loop, active perception, pervasive computing, 3D audio
Subjects:G Mathematical and Computer Sciences > G400 Computer Science
Divisions:College of Science > School of Computer Science
ID Code:11636
Deposited On:16 Aug 2013 14:28

Repository Staff Only: item control page