Robot PBL using Object Detection AI in the Department of Mechanical Engineering

Abstract

Although there are almost no courses on machine learning in the current curriculum of the Department of Mechanical Engineering at the Shizuoka Institute of science and technology, we conducted a PBL course for third-year students in which they used the results of object detection by Yolo to transport an object with a robot arm and hand of their own design. The instructor gave the students a sample program of YOLO and a hand to transport an object. The teacher only presented YOLO sample programs and the concept of coordinate transformation, and the students carried out all aspects of conception, design, fabrication, and programming. As a result, one of the two groups succeeded in their mission.