Active Object Search with a Mobile Device for People with Visual Impairments

Lock, Jacobus and Cielniak, Grzegorz and Bellotto, Nicola (2019) Active Object Search with a Mobile Device for People with Visual Impairments. In: 14th International Conference on Computer Vision Theory and Applications (VISAPP), 25-27 February 2019, Prague, Czech Republic.

Full content URL: https://doi.org/10.5220/0007582304760485

Documents
Active Object Search with a Mobile Device for People with Visual Impairments
Accepted Manuscript
[img]
[Download]
[img] PDF
Lock2019.pdf - Whole Document

9MB
Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive

Abstract

Modern smartphones can provide a multitude of services to assist people with visual impairments, and their cameras in particular can be useful for assisting with tasks, such as reading signs or searching for objects in unknown environments. Previous research has looked at ways to solve these problems by processing the camera's video feed, but very little work has been done in actively guiding the user towards specific points of interest, maximising the effectiveness of the underlying visual algorithms. In this paper, we propose a control algorithm based on a Markov Decision Process that uses a smartphone’s camera to generate real-time instructions to guide a user towards a target object. The solution is part of a more general active vision application for people with visual impairments. An initial implementation of the system on a smartphone was experimentally evaluated with participants with healthy eyesight to determine the performance of the control algorithm. The results show the effectiveness of our solution and its potential application to help people with visual impairments find objects in unknown environments.

Keywords:active vision, object search, vision impairment, Markov Decision Process
Subjects:G Mathematical and Computer Sciences > G700 Artificial Intelligence
G Mathematical and Computer Sciences > G740 Computer Vision
H Engineering > H672 Cybernetics
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:34596
Deposited On:14 Feb 2019 15:57

Repository Staff Only: item control page