A novel unified deep neural networks methodology for use by date recognition in retail food package image

Gong, Liyun, Thota, Mamatha, Yu, Miao , Duan, Wenting, Swainson, Mark, Ye, Xujiong and Kollias, Stefanos (2020) A novel unified deep neural networks methodology for use by date recognition in retail food package image. Signal, Image and Video Processing . ISSN 1863-1711

Full content URL: https://doi.org/10.1007/s11760-020-01764-7

Documents
A novel unified deep neural networks methodology for use by date recognition in retail food package image
Authors' Accepted Manuscript
[img] PDF
template.pdf - Whole Document
Restricted to Repository staff only until 1 September 2021.

17MB
Item Type:Article
Item Status:Live Archive

Abstract

There exist various types of information on retail food packages, including use by date, food product name and so on. The correct coding of use by dates on food packages is vitally important for avoiding potential health risks to customers caused by erroneous mislabelling of use by dates. It is extremely tedious and laborious to check the use by dates coding manually by a human operator, which is prone to generate errors thus an automatic system for validating the correctness of the coding of use by dates is needed. In order to construct such a system, firstly it needs to correctly automatic recognise use by dates on food packages. In this work, we propose a novel dual deep neural networks based methodology for automatic recognition of use by dates in food package photos recorded by a camera, which is a combination of two networks: a fully convolutional network (FCN) for use by date ROI detection and a convolutional recurrent neuron network (CRNN) for date character recognition. The proposed methodology is the first attempt to apply deep learning for automatic use by date recognition. From comprehensive experimental evaluations, it is shown that the proposed method can achieve high accuracies in use by date recognition (more than 95% on our testing dataset), given food package images with varying lighting conditions, poor printing quality and varied textual/pictorial contents collected from multiple real retailer sites.

Keywords:convolutional recurrent neuron network (CRNN), expiry date recognition, food security, Deep learning, fully convolutional network (FCN)
Subjects:G Mathematical and Computer Sciences > G700 Artificial Intelligence
G Mathematical and Computer Sciences > G740 Computer Vision
Divisions:College of Science > School of Computer Science
ID Code:42679
Deposited On:19 Oct 2020 13:35

Repository Staff Only: item control page