Development of an autonomous kiwifruit harvester : a thesis presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Industrial Automation at Massey University, Manawatu, New Zealand.

Abstract

The already intensive labour requirements within the New Zealand kiwifruit industry are increasing.
\nFurthermore, ZESPRI Group Limited is targeting a threefold increase in industry return
\nby 2025 (from approximately $NZ1Billion to $NZ3Billion). Development of autonomous
\nmechanised solutions to assist manual labour is emerging as a strategic necessity.
\nThe objective of this research was to develop a commercially viable autonomous kiwifruit harvester
\n(AKH). The AKH must be capable of operating within variable and complex on-orchard
\nenvironments to minimise manual labour requirements. Successful completion required development
\nand integration of autonomous:
\n1. Fruit identification and localisation
\n2. Custom robotic arms with soft fruit extraction harvesting hands
\n3. Custom robotic arm for soft fruit handling
\n4. Transportation platform with navigational sensing and strategies
\n5. Storage bin collection and drop-off
\nThe AKH has four robotic harvesting arms with hands specifically designed to mimic the human
\nfruit harvesting action. Remotely mounted stereoscopic vision identifies and localises fruit.
\nThe fruit locations are mapped into the harvesting arms’ coordinate space allowing fruit extraction.
\nThe presented system configuration resolves the slow harvest rates experienced by other
\nsystems. Practical on-orchard testing identified additional environmental complexities that present
\nthe greatest challenge to consistent fruit identification. These are mainly from natural
\nlighting effects.
\nStereoscopic machine vision (SMV) was investigated as the primary navigation sensor. However,
\ndiverse environmental conditions (lighting and structure appearance) made consistent object
\ndetection unreliable. Consequently, a light detection and ranging/SMV combination was
\nused to achieve reliable navigational object detection and fruit storage bin identification.
\nPractical on-orchard testing and analysis verified AKH operational ability (testing was limited
\ndue to a vine killing bacterial (Psa-V) outbreak restricting orchard access):
\n1. Fruit identification (83.6% of crop) with combined localisation and extraction accuracy
\nof 3.6mm in three-dimensional space
\n2. More gentle fruit harvesting and handling than humans harvesting
\n3. Reliable object detection and path planning for navigation. Over the twenty metre
\nscanning range 96% of the in-row objects were correctly classified to reliably determine
\nthe drive path
\n4. Reliable fruit storage bin identification and localisation (98% correct classification)
\n5. Commercially viable manufacture cost less than $130,000 per unit
\n6. Although full commercial operation was not achieved, modifications are identified to
\nrectify the limitations
\nKey system improvements are presented for:
\n1. High intensity artificial lighting for increased fruit identification rates. Natural sunlight
\nvariations affected identification ability, minimising this affect will increase identification
\nrates
\n2. Alter the storage bin filling arm geometry to permit complete storage bin filling
\n3. Sensing the robotic arms’ position to resolve positioning errors
\nFurthermore, ZESPRI Group Limited is targeting a threefold increase in industry return
\nby 2025 (from approximately $NZ1Billion to $NZ3Billion). Development of autonomous
\nmechanised solutions to assist manual labour is emerging as a strategic necessity.
\nThe objective of this research was to develop a commercially viable autonomous kiwifruit harvester
\n(AKH). The AKH must be capable of operating within variable and complex on-orchard
\nenvironments to minimise manual labour requirements. Successful completion required development
\nand integration of autonomous:
\n1. Fruit identification and localisation
\n2.