The YOLO-OBB-Based Approach for Citrus Fruit Stem Pose Estimation and Robot Picking

Abstract

Precise localization of the fruit stem picking point is crucial for robots to achieve efficient harvesting operations. However, in unstructured orchard environments, citrus fruit stems are easily obscured by branches and leaves and affected by factors such as overlapping fruits. This leads to poor picking localization accuracy for robots, impacting their autonomous picking efficiency. Therefore, this paper proposes a method for estimating the posture of citrus fruit stems and performing picking operations under environmental occlusion, based on the YOLO-OBB algorithm. First, the YOLOv5s algorithm detects the ROI of citrus, combined with depth information to obtain their 3D point clouds. Second, the OBB algorithm constructs oriented point cloud bounding boxes to determine stem orientation and picking point locations. Finally, through hand–eye pose transformation of the robotic arm, the end-effector is controlled to achieve precise picking operations. Experimental results indicate that the average picking success rate of the YOLO-OBB algorithm reaches 82%, representing a 50% improvement over approaches without fruit stem estimation. This conclusively shows that the proposed algorithm provides precise fruit stem pose estimation, effectively enhancing robotic picking success rates under constrained fruit stem detection conditions. It offers crucial technical support for autonomous robotic harvesting operations.