An adaptable deep learning system for optical character verification in retail food packaging

De Sousa Ribeiro, Fabio, Caliva, Francesco, Swainson, Mark , Gudmundsson, Kjartan, Leontidis, Georgios and Kollias, Stefanos (2018) An adaptable deep learning system for optical character verification in retail food packaging. 2018 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS) . pp. 1-8. ISSN 2473-4691

Full content URL:

31350 EAIS_Leontidis_preprint.pdf
31350 EAIS_Leontidis_preprint.pdf - Whole Document

Item Type:Article
Item Status:Live Archive


Retail food packages contain various types of information such as food name, ingredients list and use by dates. Such information is critical to ensure proper distribution of products to the market and eliminate health risks due to erroneous mislabelling. The latter is considerably detrimental to both consumers and suppliers alike. In this paper, an adaptable deep learning based system is proposed and tested across various possible scenarios: a) for the identification of blurry images and/or missing information from food packaging photos. These were captured during the validation process in supply chains; b) for deep neural network adaptation. This was achieved through a novel methodology that utilises facets of the same convolutional neural network architecture. Latent variables were extracted from different datasets and used as input into a k-means clustering and k-nearest neighbour classification algorithm, to compute a new set of centroids which better adapts to the target dataset’s distribution. Furthermore, visualisation and analysis of network adaptation provides insight into how higher accuracy was achieved when compared to the original deep neural network. The proposed system performed very well in the conducted experiments, showing that it can be deployed in real-world supply chains, for automating the verification process, cutting down costs and eliminating errors that could prove risky for public health.

Keywords:Deep Learning, Optical Character Verification, Food Manufacturing
Subjects:G Mathematical and Computer Sciences > G400 Computer Science
G Mathematical and Computer Sciences > G760 Machine Learning
Divisions:College of Science > School of Computer Science
ID Code:31350
Deposited On:04 Apr 2018 13:46

Repository Staff Only: item control page