HoloBand: An Augmented Reality Experience to Train Music Perception for the Hard of Hearing using the HoloLens 2

HoloBand

HoloBand is a clinical tool for audiovisual music perception training in augmented reality (AR) using the Hololens 2 for the hard-of-hearing (HoH).

It consists of two interfaces: a spatial environment in AR for the HoH user and a computer interface to control the training for speech and language pathologists (SLP).

We adopt a participatory exploratory research approach to investigate novel ways of conducting timbre discrimination, audio localization, and pitch recognition. HoloBand is evaluated using a focus group with SLPs (n=6) and interpreted through inductive thematic analysis.

Hololens 2 shows relevant contextual, visual capabilities to enhance music perception training. However, a closer integration into the clinical workflow and a task-oriented approach is necessary to bring real-life scenarios to the clinical setting.

Selected Publications