Kinematic-Based Classification of Social Gestures and Grasping by Humans and Machine Learning Techniques

Hemeren, Paul and Veto, Peter and Thill, Serge and Li, Cai and Sun, Jiong (2021) Kinematic-Based Classification of Social Gestures and Grasping by Humans and Machine Learning Techniques. Frontiers in Robotics and AI, 8. ISSN 2296-9144

[thumbnail of pubmed-zip/versions/4/package-entries/frobt-08-699505-r3/frobt-08-699505.pdf] Text
pubmed-zip/versions/4/package-entries/frobt-08-699505-r3/frobt-08-699505.pdf - Published Version

Download (2MB)

Abstract

The affective motion of humans conveys messages that other humans perceive and understand without conventional linguistic processing. This ability to classify human movement into meaningful gestures or segments plays also a critical role in creating social interaction between humans and robots. In the research presented here, grasping and social gesture recognition by humans and four machine learning techniques (k-Nearest Neighbor, Locality-Sensitive Hashing Forest, Random Forest and Support Vector Machine) is assessed by using human classification data as a reference for evaluating the classification performance of machine learning techniques for thirty hand/arm gestures. The gestures are rated according to the extent of grasping motion on one task and the extent to which the same gestures are perceived as social according to another task. The results indicate that humans clearly rate differently according to the two different tasks. The machine learning techniques provide a similar classification of the actions according to grasping kinematics and social quality. Furthermore, there is a strong association between gesture kinematics and judgments of grasping and the social quality of the hand/arm gestures. Our results support previous research on intention-from-movement understanding that demonstrates the reliance on kinematic information for perceiving the social aspects and intentions in different grasping actions as well as communicative point-light actions.

Item Type: Article
Subjects: Open Research Librarians > Mathematical Science
Depositing User: Unnamed user with email support@open.researchlibrarians.com
Date Deposited: 23 Jun 2023 07:25
Last Modified: 09 Oct 2023 06:34
URI: http://stm.e4journal.com/id/eprint/1321

Actions (login required)

View Item
View Item