• xmlui.mirage2.page-structure.header.title
    • français
    • English
  • Help
  • Login
  • Language 
    • Français
    • English
View Item 
  •   BIRD Home
  • LAMSADE (UMR CNRS 7243)
  • LAMSADE : Publications
  • View Item
  •   BIRD Home
  • LAMSADE (UMR CNRS 7243)
  • LAMSADE : Publications
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Browse

BIRDResearch centres & CollectionsBy Issue DateAuthorsTitlesTypeThis CollectionBy Issue DateAuthorsTitlesType

My Account

LoginRegister

Statistics

Most Popular ItemsStatistics by CountryMost Popular Authors
Thumbnail

LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech

Evain, Solène; Nguyen, Ha; Le, Hang; Zanon Boito, Marcely; Mdhaffar, Salima; Alisamir, Sina; Tong, Ziyi; Tomashenko, Natalia; Dinarelli, Marco; Parcollet, Titouan; Allauzen, Alexandre (2021), LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech, NTERSPEECH 2021: Conference of the International Speech Communication Association, 2021-08, Brno, Czech Republic

View/Open
2104.11462.pdf (140.7Kb)
Type
Communication / Conférence
Date
2021
Conference title
NTERSPEECH 2021: Conference of the International Speech Communication Association
Conference date
2021-08
Conference city
Brno
Conference country
Czech Republic
Metadata
Show full item record
Author(s)
Evain, Solène
Nguyen, Ha
Le, Hang
Zanon Boito, Marcely
Mdhaffar, Salima
Alisamir, Sina
Tong, Ziyi
Tomashenko, Natalia
Dinarelli, Marco
Parcollet, Titouan
Allauzen, Alexandre
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Abstract (EN)
Self-Supervised Learning (SSL) using huge unlabeled data has been successfully explored for image and natural language processing. Recent works also investigated SSL from speech. They were notably successful to improve performance on downstream tasks such as automatic speech recognition (ASR). While these works suggest it is possible to reduce dependence on labeled data for building efficient speech systems, their evaluation was mostly made on ASR and using multiple and heterogeneous experimental settings (most of them for English). This questions the objective comparison of SSL approaches and the evaluation of their impact on building speech systems. In this paper, we propose LeBenchmark: a reproducible framework for assessing SSL from speech. It not only includes ASR (high and low resource) tasks but also spoken language understanding, speech translation and emotion recognition. We also focus on speech technologies in a language different than English: French. SSL models of different sizes are trained from carefully sourced and documented datasets. Experiments show that SSL is beneficial for most but not all tasks which confirms the need for exhaustive and reliable benchmarks to evaluate its real impact. LeBenchmark is shared with the scientific community for reproducible research in SSL from speech.
Subjects / Keywords
Self-Supervised Representation Learning; ASR; SLU; Speech Translation; Automatic Emotion Recognition

Related items

Showing items related by title and author.

  • Thumbnail
    Task Agnostic and Task Specific Self-Supervised Learning from Speech with LeBenchmark 
    Evain, Solène; Nguyen, Manh Ha; Le, Hang; Zanon Boito, Marcely; Mdhaffar, Salima; Alisamir, Sina; Tong, Ziyi; Tomashenko, Natalia; Dinarelli, Marco; Parcollet, Titouan; Allauzen, Alexandre (2021) Communication / Conférence
  • Thumbnail
    Extension des Programmes Génétiques pour l’apprentissage supervisé à partir de très larges Bases de Données (Big data) 
    Hmida, Hmida (2019-10-23) Thèse
  • Thumbnail
    Leveraging the structure of dynamical systems for data-driven modeling 
    Bucci, Michele; Semeraro, Onofrio; Allauzen, Alexandre; Chibbaro, Sergio; Mathelin, Lionel (2021) Document de travail / Working paper
  • Thumbnail
    Developing a framework for assessing global information systems success : perceived individual effectiveness and organizational impacts 
    Kefi, Hajer (2000) Communication / Conférence
  • Thumbnail
    Real vs. Virtual: A Theoretical Framework for Assessing the Role of Authenticity in Visitor Interactions with Museum Technologies 
    Pallud, Jessie; Straub, Detmar W. (2007) Communication / Conférence
Dauphine PSL Bibliothèque logo
Place du Maréchal de Lattre de Tassigny 75775 Paris Cedex 16
Phone: 01 44 05 40 94
Contact
Dauphine PSL logoEQUIS logoCreative Commons logo