Search publications

Reset filters Search by keyword

No publications found.

 

Auditory and vibrotactile interactions in perception of timbre acoustic features

Authors: Chauvette LSophie Grenier AAlbouy PCoffey EZatorre RSharp A


Affiliations

1 CERVO Brain Research Centre Université Laval, G1E 1T2, Quebec City, Canada. loonan.chauvette@cervo.ulaval.ca.
2 Faculty of Medicine, Université Laval, G1V 0A6, Quebec City, Canada. loonan.chauvette@cervo.ulaval.ca.
3 CERVO Brain Research Centre Université Laval, G1E 1T2, Quebec City, Canada.
4 School of Psychology, Laval University, Quebec City, G1V 0A6, Canada.
5 Concordia University, Montreal, H3G 1M8, Canada.
6 Montreal Neurological Institute McGill University, Montreal, H3A 2B4, Canada.
7 Centre for Research on Brain, Language and Music (CRBLM), McGill University, Montreal, H3G 2A8, Canada.
8 International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, H2V 2S9, Canada.
9 Faculty of Medicine, Université Laval, G1V 0A6, Quebec City, Canada.

Description

Recently, there has been increasing interest in developing auditory-to-vibrotactile sensory devices. However, the potential of these technologies is constrained by our limited understanding of which features of complex sounds can be perceived through vibrations. The present study aimed to investigate the vibrotactile perception of acoustic features related to timbre, an essential component to identify environmental, speech and musical sounds. Discrimination thresholds were measured for six features: three spectral (number of harmonics, harmonic roll-off ratio, even-harmonic attenuation) and three temporal (attack time, amplitude modulation depth and amplitude modulation frequency) using auditory, vibrotactile and combined auditory + vibrotactile stimulation in 31 adult humans with normal tactile and auditory sensitivity. Result revealed that all spectral and temporal features can be reliably discriminated via vibrotactile stimulation only. However, for spectral features, vibrotactile thresholds were significantly higher (i.e., worse) than auditory thresholds whereas, for temporal features, only vibrotactile amplitude modulation frequency was significantly higher. With simultaneous auditory and tactile presentation, thresholds significantly improved for attack time and amplitude modulation depth, but not for any of the spectral acoustic features. These results suggest that vibrotactile temporal cues have a more straightforward potential for assisting auditory perception, while vibrotactile spectral cues may require specialized signal processing schemes.


Keywords: Assistive technologyAuditionMultimodal perceptionSensory substitutionTimbreVibrotactile


Links

PubMed: https://pubmed.ncbi.nlm.nih.gov/41168236/

DOI: 10.1038/s41598-025-21908-4