Modelling state of interaction from head poses for social human-robot interaction

Gaschler, A., Huth, K., Giuliani, M., Kessler, I., de Ruiter, J. and Knoll, A. (2012) Modelling state of interaction from head poses for social human-robot interaction. In: Gaze in Human-Robot Interaction Workshop at the 7th ACM/IEEE International Conference on Human-Robot Interaction, Boston, MA, USA, 03.-08. March 2012. Boston, USA: UNSPECIFIED Available from:

Full text not available from this repository


In this publication, we analyse how humans use head pose in various states of an interaction, in both human-human and human-robot observations. Our scenario is the short-term, every-day interaction of a customer ordering a drink from a bartender. To empirically study the use of head pose in this scenario, we recorded 108 such interactions in real bars. The analysis of these recordings shows, (i) customers follow a defined script to order their drink—attention request, ordering, closing of interaction—and (ii) customers use head pose to nonverbally request the attention of the bartender, to signal the ongoing process, and to close the interaction. Based on these findings, we design a hidden Markov model that reflects the typical interaction states in the bar scenario and implement it on the human-robot interaction system of the European JAMES project. We train the model with data from an automatic head pose estimation algorithm and additional body pose information. Our evaluation shows that the model correctly recognises the state of interaction of a customer in 78.3% of all states. More specifically, the model recognises the interaction state “attention to bartender” with 83.8% and “attention to another guest” with 73.0% correctness, providing the robot sufficient knowledge to begin, perform, and end interactions in a socially appropriate way.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:modelling, state, interaction, head, poses, social, human-robot, interaction
Faculty/Department:Faculty of Environment and Technology > Department of Engineering Design and Mathematics
ID Code:31044
Deposited By: Dr M. Giuliani
Deposited On:21 Feb 2017 15:11
Last Modified:21 Feb 2017 15:11

Request a change to this item