Perception, navigation, and manipulation in the team KAUST approach to the MBZIRC ground robotics challenge
Algarni, Mohammed Abdullah
Shaqura, Mohammad Z.
Mabrok, Mohamed A.
Shamma, Jeff S.
KAUST DepartmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Physical Sciences and Engineering (PSE) Division
Mechanical Engineering Program
Ali I. Al-Naimi Petroleum Engineering Research Center (ANPERC)
Electrical Engineering Program
Robotics, Intelligent Systems, and Control (RISC) Lab; King Abdullah University of Science and Technology (KAUST); Thuwal Saudi Arabia
Permanent link to this recordhttp://hdl.handle.net/10754/652971
MetadataShow full item record
AbstractThe ground robotics challenge in the Mohammed Bin Zayed International Robotics Challenge required a ground vehicle equipped with a robotic arm to autonomously locate a panel, select a proper size wrench among several options mounted on the panel, and use the wrench to rotate a valve. Autonomy was the critical factor in this challenge, which required the teams to devise algorithms that can operate successfully in a semistructured environment without human supervision. This paper presents the approaches taken by team KAUST to meet this challenge, ranging from in-house hardware designs to algorithm integration and customization. We separated the whole objective into three interconnected tasks: Navigation, perception, and manipulation. For the navigation task, we developed a basic robotic exploration scheme to find the panel front side where the wrenches were present. For the perception task, we integrated common object detection algorithms with neural networks to identify the proper size wrench precisely. For successful manipulation, we designed and built a custom gripper, which was inspired by the common grasping behavior of a human hand under tight clearance conditions. The modular structure of the proposed approach allowed the team to progress in several subtasks simultaneously. However, the interconnection between the subtasks necessitated a reliable integration framework between these modules for effective implementation. We tuned our algorithms in extensive experimental studies and eventually obtained 10 consecutive successful navigation runs, 96% true wrench detection rate, and high success rate in wrench grasping. Furthermore, successful complete tests proved the reliability and repeatability of our system.
CitationGüler S, Algarni MA, Shaqura MZ, Jaleel H, Mabrok MA, et al. (2019) Perception, navigation, and manipulation in the team KAUST approach to the MBZIRC ground robotics challenge. Journal of Field Robotics. Available: http://dx.doi.org/10.1002/rob.21865.
SponsorsThe research reported in this publication was supported by funding from King Abdullah University of Science and Technology (KAUST).
JournalJournal of Field Robotics