Integration of Deep Learning and Collaborative Robot for Assembly Tasks

Mendez, Enrico and Ochoa, Oscar and Olivera-Guzman, David and Soto-Herrera, Victor Hugo and Luna-Sánchez, José Alfredo and Lucas-Dophe, Carolina and Lugo-del-Real, Eloina and Ayala-Garcia, Ivo Neftali and Alvarado Perez, Miriam and González, Alejandro (2024) Integration of Deep Learning and Collaborative Robot for Assembly Tasks. Applied Sciences, 14 (2). p. 839. ISSN 2076-3417

[thumbnail of applsci-14-00839.pdf] Text
applsci-14-00839.pdf - Published Version

Download (6MB)

Abstract

Human–robot collaboration has gained attention in the field of manufacturing and assembly tasks, necessitating the development of adaptable and user-friendly forms of interaction. To address this demand, collaborative robots (cobots) have emerged as a viable solution. Deep Learning has played a pivotal role in enhancing robot capabilities and facilitating their perception and understanding of the environment. This study proposes the integration of cobots and Deep Learning to assist users in assembly tasks such as part handover and storage. The proposed system includes an object classification system to categorize and store assembly elements, a voice recognition system to classify user commands, and a hand-tracking system for close interaction. Tests were conducted for each isolated system and for the complete application as used by different individuals, yielding an average accuracy of 91.25%. The integration of Deep Learning into cobot applications has significant potential for transforming industries, including manufacturing, healthcare, and assistive technologies. This work serves as a proof of concept for the use of several neural networks and a cobot in a collaborative task, demonstrating communication between the systems and proposing an evaluation approach for individual and integrated systems.

Item Type: Article
Subjects: Open Research Librarians > Multidisciplinary
Depositing User: Unnamed user with email support@open.researchlibrarians.com
Date Deposited: 22 Jan 2024 06:20
Last Modified: 22 Jan 2024 06:20
URI: http://stm.e4journal.com/id/eprint/2451

Actions (login required)

View Item
View Item