Multisensory guidance of goal-oriented behaviour of legged robots

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review


Biological systems often combine cues from two different sensory modalities to execute goal-oriented sensorimotor tasks, which otherwise cannot be accurately executed with either sensory stream in isolation. When auditory cues alone are not sufficient to accurately localise an audio-visual target by orienting towards it, visual cues can complement their auditory counterparts and improve localisation accuracy. We present a multisensory goal-oriented locomotion control architecture that uses visual feedback to adaptively improve acoustomotor orientation response of the hexapod robot AMOS II. The robot is tasked with localising an audio-visual target by turning towards it. The architecture extracts sound direction information with a model of the peripheral auditory system of lizards to modulate locomotion control parameters driving the turning behaviour. The visual information adaptively changes the strength of the acoustomotor coupling to adjust turning speed of the robot. Our experiments demonstrate improved orientation towards the audio-visual target emitting a tone of frequency 2.2kHz located at an angular offset of 45 degrees from the robot.
Original languageEnglish
Title of host publicationHuman-centric Robotics : Proceedings of the 20th International Conference on CLAWAR 2017
EditorsManuel F. Silva, Gurvinder S. Virk, Mohammad O Tokhi, Benedita Malheiro, Paulo Ferreira, Pedro Guedes
PublisherWorld Scientific
Publication date2017
ISBN (Print)978-981-3231-03-0
ISBN (Electronic)978-981-3231-05-4 , 978-981-3231-04-7
Publication statusPublished - 2017
Event20th International Conference on Climbing and Walking Robots and Support Technologies for Mobile Machines - Instituto Superior de Engenharia do Porto, Porto, Portugal
Duration: 11. Sep 201713. Sep 2017


Conference20th International Conference on Climbing and Walking Robots and Support Technologies for Mobile Machines
LocationInstituto Superior de Engenharia do Porto
Internet address


  • lizard peripheral auditory system
  • audio-visual localisation
  • multisensory integration
  • hexapedal locomotion


Dive into the research topics of 'Multisensory guidance of goal-oriented behaviour of legged robots'. Together they form a unique fingerprint.

Cite this