Robot Task Primitive Segmentation from Demonstrations Using Only Built-in Kinematic State and Force-Torque Sensor Data

Publikation: Kapitel i bog/rapport/konference-proceedingKonferencebidrag i proceedingsForskningpeer review

Abstract

This paper presents a method for segmentation and classification of kinesthetic demonstrations of robot peg-in-hole tasks using a deep neural network. The presented method depends only on sensor data that is readily available on collaborative robots (kinematic state and forcetorque readings) and does not need any additional sensors. Our method can be used to automatically derive program structures from a single demonstration of a robot task. This can reduce programming time, and make it easier to revise sections of a larger task. We introduce a combined architecture consisting of a Convolutional Neural Network block for raw feature extraction and a Long Short-Term Memory block for tracking the time-evolution of these features. We also extend the model from binary insertion segmentation to multi-class segmentation including pick up, place, free air motions, insertions, and extraction. Through an ablation study and comparison to previous work, we show that the new model performs better on the test set, containing one demonstrator, but significantly better on a generalization set consisting of ten previously unseen demonstrators, reaching an overall accuracy of 70%, which is 15 percentage points better than the closest-performing other method.

OriginalsprogEngelsk
Titel2023 IEEE 19th International Conference on Automation Science and Engineering (CASE)
Antal sider7
ForlagIEEE Computer Society
Publikationsdato2023
ISBN (Elektronisk)9798350320695
DOI
StatusUdgivet - 2023
Begivenhed19th IEEE International Conference on Automation Science and Engineering, CASE 2023 - Auckland, New Zealand
Varighed: 26. aug. 202330. aug. 2023

Konference

Konference19th IEEE International Conference on Automation Science and Engineering, CASE 2023
Land/OmrådeNew Zealand
ByAuckland
Periode26/08/202330/08/2023
SponsorBeckhoff, CTEK - Combined Technologies
NavnIEEE International Conference on Automation Science and Engineering
Vol/bind2023-August
ISSN2161-8070

Bibliografisk note

Publisher Copyright:
© 2023 IEEE.

Fingeraftryk

Dyk ned i forskningsemnerne om 'Robot Task Primitive Segmentation from Demonstrations Using Only Built-in Kinematic State and Force-Torque Sensor Data'. Sammen danner de et unikt fingeraftryk.

Citationsformater