ActiVis: Mobile Object Detection and Active Guidance for People with Visual Impairments

Lock, Jacobus and Tramontano, A. G. and Ghidoni, S. and Bellotto, Nicola (2019) ActiVis: Mobile Object Detection and Active Guidance for People with Visual Impairments. In: Proc. of the Int. Conf. on Image Analysis and Processing (ICIAP), 9-13 Sept 2019, Trento, Italy.

Full text not available from this repository.

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive

Abstract

The ActiVis project aims to deliver a mobile system that is able to guide a person with visual impairments towards a target object or area in an unknown indoor environment. For this, it uses new developments in object detection, mobile computing, action generation and human-computer interfacing to interpret the user's surroundings and present effective guidance directions. Our approach to direction generation uses a Partially Observable Markov Decision Process (POMDP) to track the system's state and output the optimal location to be investigated. This system includes an object detector and an audio-based guidance interface to provide a complete active search pipeline. The ActiVis system was evaluated in a set of experiments showing better performance than a simpler unguided case.

Keywords:Active vision, vision impairment, object detection
Subjects:G Mathematical and Computer Sciences > G700 Artificial Intelligence
H Engineering > H672 Cybernetics
G Mathematical and Computer Sciences > G740 Computer Vision
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:36413
Deposited On:19 Jul 2019 10:22

Repository Staff Only: item control page