Interactivity and multimodality in language learning

The untapped potential of audiobooks

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

In this work, we present three case studies, involving classes in primary and secondary schools, in Denmark. The studies, conducted in the past 2 years, show how audio content can be generated and shared among teachers and learners, how audio material can be made more interactive to offer fruition similar to that of digital games, and how language learning can benefit from adding a social dimension to audiobooks. All case studies were conducted in a user-centered fashion and build on social semiotics, in which interactive audiobooks are seen as providing new ways to receive, interpret, and share literary texts. Local primary and secondary schools were involved in ethnographic user studies and qualitative evaluations with semi-functioning prototypes. In the main case study presented, social interaction was chosen as key feature to allow high-school students and teachers to annotate audiobooks, then share and comment on the annotations; the social context in this case is a digitally augmented English teaching class. To better investigate the potential of sharable audiobook annotations, we also created a mockup supporting the workflow of the main case study, using standard YouTube annotations and freely available audiobooks. The findings and technical solutions explored in the three studies are the basis for design guidelines aiming at making audiobooks interactive and better integrated in learning contexts.
Original languageEnglish
JournalUniversal Access in the Information Society
Volume17
Issue number2
Pages (from-to)257–274
ISSN1615-5289
DOIs
Publication statusPublished - 1. Jun 2018

Fingerprint

Semiotics
Teaching
Students

Keywords

  • e-learning
  • Multimodal interaction
  • Information presentation
  • Knowledge management

Cite this

@article{55f1742362d2436b8809a16a0e176c68,
title = "Interactivity and multimodality in language learning: The untapped potential of audiobooks",
abstract = "In this work, we present three case studies, involving classes in primary and secondary schools, in Denmark. The studies, conducted in the past 2 years, show how audio content can be generated and shared among teachers and learners, how audio material can be made more interactive to offer fruition similar to that of digital games, and how language learning can benefit from adding a social dimension to audiobooks. All case studies were conducted in a user-centered fashion and build on social semiotics, in which interactive audiobooks are seen as providing new ways to receive, interpret, and share literary texts. Local primary and secondary schools were involved in ethnographic user studies and qualitative evaluations with semi-functioning prototypes. In the main case study presented, social interaction was chosen as key feature to allow high-school students and teachers to annotate audiobooks, then share and comment on the annotations; the social context in this case is a digitally augmented English teaching class. To better investigate the potential of sharable audiobook annotations, we also created a mockup supporting the workflow of the main case study, using standard YouTube annotations and freely available audiobooks. The findings and technical solutions explored in the three studies are the basis for design guidelines aiming at making audiobooks interactive and better integrated in learning contexts.",
keywords = "e-learning , Multimodal interaction , Information presentation, Knowledge management",
author = "Emanuela Marchetti and Andrea Valente",
year = "2018",
month = "6",
day = "1",
doi = "10.1007/s10209-017-0549-5",
language = "English",
volume = "17",
pages = "257–274",
journal = "Universal Access in the Information Society",
issn = "1615-5289",
publisher = "Heinemann",
number = "2",

}

Interactivity and multimodality in language learning : The untapped potential of audiobooks. / Marchetti, Emanuela; Valente, Andrea.

In: Universal Access in the Information Society, Vol. 17, No. 2, 01.06.2018, p. 257–274.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Interactivity and multimodality in language learning

T2 - The untapped potential of audiobooks

AU - Marchetti, Emanuela

AU - Valente, Andrea

PY - 2018/6/1

Y1 - 2018/6/1

N2 - In this work, we present three case studies, involving classes in primary and secondary schools, in Denmark. The studies, conducted in the past 2 years, show how audio content can be generated and shared among teachers and learners, how audio material can be made more interactive to offer fruition similar to that of digital games, and how language learning can benefit from adding a social dimension to audiobooks. All case studies were conducted in a user-centered fashion and build on social semiotics, in which interactive audiobooks are seen as providing new ways to receive, interpret, and share literary texts. Local primary and secondary schools were involved in ethnographic user studies and qualitative evaluations with semi-functioning prototypes. In the main case study presented, social interaction was chosen as key feature to allow high-school students and teachers to annotate audiobooks, then share and comment on the annotations; the social context in this case is a digitally augmented English teaching class. To better investigate the potential of sharable audiobook annotations, we also created a mockup supporting the workflow of the main case study, using standard YouTube annotations and freely available audiobooks. The findings and technical solutions explored in the three studies are the basis for design guidelines aiming at making audiobooks interactive and better integrated in learning contexts.

AB - In this work, we present three case studies, involving classes in primary and secondary schools, in Denmark. The studies, conducted in the past 2 years, show how audio content can be generated and shared among teachers and learners, how audio material can be made more interactive to offer fruition similar to that of digital games, and how language learning can benefit from adding a social dimension to audiobooks. All case studies were conducted in a user-centered fashion and build on social semiotics, in which interactive audiobooks are seen as providing new ways to receive, interpret, and share literary texts. Local primary and secondary schools were involved in ethnographic user studies and qualitative evaluations with semi-functioning prototypes. In the main case study presented, social interaction was chosen as key feature to allow high-school students and teachers to annotate audiobooks, then share and comment on the annotations; the social context in this case is a digitally augmented English teaching class. To better investigate the potential of sharable audiobook annotations, we also created a mockup supporting the workflow of the main case study, using standard YouTube annotations and freely available audiobooks. The findings and technical solutions explored in the three studies are the basis for design guidelines aiming at making audiobooks interactive and better integrated in learning contexts.

KW - e-learning

KW - Multimodal interaction

KW - Information presentation

KW - Knowledge management

U2 - 10.1007/s10209-017-0549-5

DO - 10.1007/s10209-017-0549-5

M3 - Journal article

VL - 17

SP - 257

EP - 274

JO - Universal Access in the Information Society

JF - Universal Access in the Information Society

SN - 1615-5289

IS - 2

ER -