Teaching a Robot the Semantics of Assembly Tasks

T. R. Savarimuthu, A. G. Buch, C. Schlette, N. Wantia, Jürgen Roßmann, D. Martinez, G. Alenya, C. Torras, Ales Ude, Bojan Nemec, Aljaz Kramberger, Florentin Worgotter, Eren Erdal Aksoy, Jérémie Papon, Simon Haller, J. Piater, N. Kruger

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

378 Downloads (Pure)


We present a three-level cognitive system in a learning by demonstration context. The system allows for learning and transfer on the sensorimotor level as well as the planning level. The fundamentally different data structures associated with these two levels are connected by an efficient mid-level representation based on so-called 'semantic event chains.' We describe details of the representations and quantify the effect of the associated learning procedures for each level under different amounts of noise. Moreover, we demonstrate the performance of the overall system by three demonstrations that have been performed at a project review. The described system has a technical readiness level (TRL) of 4, which in an ongoing follow-up project will be raised to TRL 6.
TidsskriftIEEE Transactions on Systems, Man, and Cybernetics: Systems
Udgave nummer5
Sider (fra-til)670-692
StatusUdgivet - 1. maj 2018