User-Defined Co-Speech Gesture Design with Swarm Robots
Minh Duc Dang, Samira Pulatova, Lawrence H. Kim

Abstract
Non-verbal signals, including co-speech gestures, play a vital role in human communication by conveying nuanced meanings beyond verbal discourse. While researchers have explored co-speech gestures in human-like conversational agents, limited attention has been given to non-humanoid alternatives. In this paper, we propose using swarm robotic systems as conversational agents and introduce a foundational set of swarm-based co-speech gestures, elicited from non-technical users and validated through an online study. This work outlines the key software and hardware requirements to advance research in co-speech gesture generation with swarm robots, contributing to the future development of social robotics and conversational agents.
Presentation
Paper
User-Defined Co-Speech Gesture Design with Swarm Robots [PDF]
Minh Duc Dang, Samira Pulatova, Lawrence H. Kim
CHI 2025