An adaptable deep learning system for optical character verification in retail food packaging

De Sousa Ribeiro, Fabio and Caliva, Francesco and Swainson, Mark and Gudmundsson, Kjartan and Leontidis, Georgios and Kollias, Stefanos (2018) An adaptable deep learning system for optical character verification in retail food packaging. In: Evolving and Adaptive Intelligent Systems, IEEE Conference on, 25-27 May 2018, Rhodes, Greece.

31350 EAIS_Leontidis_preprint.pdf
31350 EAIS_Leontidis_preprint.pdf - Whole Document

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


Retail food packages contain various types of information such as food name, ingredients list and use by dates. Such information is critical to ensure proper distribution of products to the market and eliminate health risks due to erroneous mislabelling. The latter is considerably detrimental to both consumers and suppliers alike. In this paper, an adaptable deep learning based system is proposed and tested across various possible scenarios: a) for the identification of blurry images and/or missing information from food packaging photos. These were captured during the validation process in supply chains; b) for deep neural network adaptation. This was achieved through a novel methodology that utilises facets of the same convolutional neural network architecture. Latent variables were extracted from different datasets and used as input into a k-means clustering and k-nearest neighbour classification algorithm, to compute a new set of centroids which better adapts to the target dataset’s distribution. Furthermore, visualisation and analysis of network adaptation provides insight into how higher accuracy was achieved when compared to the original deep neural network. The proposed system performed very well in the conducted experiments, showing that it can be deployed in real-world supply chains, for automating the verification process, cutting down costs and eliminating errors that could prove risky for public health.

Keywords:Deep Learning, Optical Character Verification, Food Manufacturing
Subjects:G Mathematical and Computer Sciences > G400 Computer Science
G Mathematical and Computer Sciences > G760 Machine Learning
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:31350
Deposited On:04 Apr 2018 13:46

Repository Staff Only: item control page