3D-vision based detection, localization, and sizing of broccoli heads in the field

Kusumam, Keerthy, Krajnik, Tomas, Pearson, Simon , Duckett, Tom and Cielniak, Grzegorz (2017) 3D-vision based detection, localization, and sizing of broccoli heads in the field. Journal of Field Robotics, 34 (8). pp. 1505-1518. ISSN 1556-4959

Full content URL: http://doi.org/10.1002/rob.21726


Request a copy
3D-vision based detection, localization, and sizing of broccoli heads in the field
Accepted Manuscript
[img] PDF
Kusumam_et_al-2017-Journal_of_Field_Robotics.pdf - Whole Document
Restricted to Repository staff only

[img] PDF
kusumam2016jfr.pdf - Whole Document

Item Type:Article
Item Status:Live Archive


This paper describes a 3D vision system for robotic harvesting of broccoli using low-cost RGB-D sensors, which was developed and evaluated using sensory data collected under real-world field conditions in both the UK and Spain. The presented method addresses the tasks of detecting mature broccoli heads in the field and providing their 3D locations relative to the vehicle. The paper evaluates different 3D features, machine learning, and temporal filtering methods for detection of broccoli heads. Our experiments show that a combination of Viewpoint Feature Histograms, Support Vector Machine classifier, and a temporal filter to track the detected heads results in a system that detects broccoli heads with high precision. We also show that the temporal filtering can be used to generate a 3D map of the broccoli head positions in the field. Additionally, we present methods for automatically estimating the size of the broccoli heads, to determine when a head is ready for harvest. All of the methods were evaluated using ground-truth data from both the UK and Spain, which we also make available to the research community for subsequent algorithm development and result comparison. Cross-validation of the system trained on the UK dataset on the Spanish dataset, and vice versa, indicated good generalization capabilities of the system, confirming the strong potential of low-cost 3D imaging for commercial broccoli harvesting.

Keywords:3D vision, agriclutural robotics, semantic mapping
Subjects:H Engineering > H670 Robotics and Cybernetics
D Veterinary Sciences, Agriculture and related subjects > D470 Agricultural Technology
G Mathematical and Computer Sciences > G740 Computer Vision
Divisions:College of Science
Related URLs:
ID Code:27782
Deposited On:05 Jul 2017 11:48

Repository Staff Only: item control page