Where do people look when tutoring a robot?

Katrin Solveig Lohan, Kerstin Fischer, Christian Dondrup, Chrystopher Nehaniv

Publikation: Konferencebidrag uden forlag/tidsskriftPaperForskningpeer review


In this paper, we investigate the relationship between tutors' gaze behavior and particular kinds of linguistic behaviors. In particular, we describe how word classes are distributed over different gazing classes. For this, we collected data from human-robot interactions and used a classification of our participants' gazing behavior to create subsets of their utterances. The participants' speech was transcribed for 3 sessions (2 min each) of interaction with the robot and classified based on the detected gazing classes (looking at the robot, looking at the object or looking somewhere else). The analysis shows that there are, for instance, more object related keywords when people are gazing at an object, and more personal pronouns when people are looking at the robot. Understanding the relationship between human tutors' linguistic and gazing behavior can facilitate bootstrapping the one capability from the other, such that gazing behavior is exploited for narrowing down the search space for object-relevant linguistic material.
Antal sider2
StatusUdgivet - 2013
BegivenhedHuman-Robot Interaction Conference - Tokyo, Japan
Varighed: 3. mar. 20137. mar. 2013


KonferenceHuman-Robot Interaction Conference

Fingeraftryk Dyk ned i forskningsemnerne om 'Where do people look when tutoring a robot?'. Sammen danner de et unikt fingeraftryk.