iHRC: An AR-based interface for intuitive, interactive and coordinated task sharing between humans and robots in building construction

Abstract

iHRC: An AR-based interface for intuitive, interactive and coordinated task sharing between humans and robots in building construction Felix Amtsberg, Xiliu Yang, Lior Skoury, Hans-Jakob Wagner and Achim Menges Pages 25-32 (2021 Proceedings of the 38th ISARC, Dubai, UAE, ISBN 978-952-69524-1-3, ISSN 2413-5844) Abstract: The research presented in this paper introduces a novel method for Augmented Reality informed human-machine collaboration in the context of timber prefabrication. The concept is based on the craftsman controlled instructive interaction between a High Level of Automation (robotic) fabrication setup and a human co-worker. It argues that by enabling the craftsmen to coordinate or take over specific process parts, a significant increase in flexibility and robustness of automated workflows becomes feasible. This is highly relevant within the project-based construction industry where efficient and flexible production of one-off components is predominant. A novel approach to integrate human and robotic co-workers in a joint fabrication setup that we call "Instructive Human Robot Collaboration" is introduced. With Vizor, a computational framework was developed for this purpose. It provides an intuitive interface between human and robotic fabrication units via a mixed reality head-mounted display (HMD). Finally, the proposed method is tested with an initial case study in which a 14-Axis fabrication setup is connected with human craft. The HMD gives a craftsman without any knowledge in robot programming direct control over the fabrication setup and extends its individual skill set. Fabrication tasks can be shared freely and between human and robotic units, enabling a dynamically adaptive workflow. Keywords: Augmented reality; instructive Human-robot collaboration; Digital Twin; project-based; Task-Skill comparison DOI: https://doi.org/10.22260/ISARC2021/0006 Download fulltext Download BibTex Download Endnote (RIS) TeX Import to Mendeley