Gaussian map predictions for 3D surface feature localisation and counting

Le Louedec, Justin and Cielniak, Grzegorz (2021) Gaussian map predictions for 3D surface feature localisation and counting. In: BMVC.

Full content URL:

Gaussian map predictions for 3D surface feature localisation and counting
Authors' Accepted Manuscript

Request a copy
[img] PDF
1417.pdf - Whole Document
Restricted to Repository staff only

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


In this paper, we propose to employ a Gaussian map representation to estimate precise location and count of 3D surface features, addressing the limitations of state-of-the-art methods based on density estimation which struggle in presence of local disturbances. Gaussian maps indicate probable object location and can be generated directly from keypoint annotations avoiding laborious and costly per-pixel annotations. We apply this method to the 3D spheroidal class of objects which can be projected into 2D shape representation enabling efficient processing by a neural network GNet, an improved UNet architecture, which generates the likely locations of surface features and their precise count. We demonstrate a practical use of this technique for counting strawberry achenes which is used as a fruit quality measure in phenotyping applications. The results of training the proposed system on several hundreds of 3D scans of strawberries from a publicly available dataset demonstrate the accuracy and precision of the system which outperforms the state-of-the-art density-based methods for this application.

Keywords:Computer vision, strawberries, achenes, 3D surface, counting, localisation
Subjects:G Mathematical and Computer Sciences > G700 Artificial Intelligence
G Mathematical and Computer Sciences > G740 Computer Vision
Divisions:College of Science > School of Computer Science
ID Code:48667
Deposited On:31 Mar 2022 14:44

Repository Staff Only: item control page