A systemic approach to automatic metadata extraction from multimedia content

Kollias, Stefanos, Varytimidis, Christos, Tsatiris, Georgios and Rapantzikos, Konstantinos (2016) A systemic approach to automatic metadata extraction from multimedia content. In: IEEE Symposium Series on Computational Intelligence SSCI 2016, December 6-9, 2016, Athens, Greece.

SSCI16_paper.pdf - Whole Document

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


There is a need for automatic processing and extracting of meaningful metadata from multimedia information,
especially in the audiovisual industry. This higher level information is used in a variety of practices, such as enriching
multimedia content with external links, clickable objects and useful related information in general. This paper presents a system for efficient multimedia content analysis and automatic annotation within a multimedia processing and publishing framework. This system is comprised of three modules: the first provides detection of faces and recognition of known persons; the second provides generic object detection, based on a deep convolutional neural network topology; the third provides automated location estimation and landmark recognition based on state-of-the-art technologies. The results are exported in meaningful metadata that can be utilized in various ways. The system has been successfully tested in the framework of the EC Horizon 2020 Mecanex project, targeting advertising and production markets.

Keywords:face & landmark detection and recognition, bag-of-words, deep neural networks
Subjects:G Mathematical and Computer Sciences > G450 Multi-media Computing Science
Divisions:College of Science > School of Computer Science
ID Code:25671
Deposited On:18 Jan 2017 16:48

Repository Staff Only: item control page