MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation
  Model Training on EU Languages
The rise of foundation models (FMs), coupled with regulatory efforts
addressing their risks and impacts, has sparked significant interest in
open-source models. However, existing speech FMs (SFMs) fall short of full
compliance with the open-source principles, even if claimed otherwise, as no
existing SFM has model weights, code, and training data publicly available
under open-source terms. In this work, we take the first step toward filling
this gap by focusing on the 24 official languages of the European Union (EU).
We collect suitable training data by surveying automatic speech recognition
datasets and unlabeled speech corpora under open-source compliant licenses, for
a total of 950k hours. Additionally, we release automatic transcripts for 441k
hours of unlabeled data under the permissive CC-BY license, thereby
facilitating the creation of open-source SFMs for the EU languages.
66fe8ce315148a910ce929e0
Marco Gaido
claimed_verified
2025-03-06T13:34:39.061Z
662e58f32b1b529a43c8b2f4
/avatars/bd26a7b26596882c6bc8a7375ff42cac.svg
Marco Gaido
user
mgaido91
66fe8ce315148a910ce929e1
Sara Papi
claimed_verified
2024-12-30T19:38:39.975Z
66309b3833ccd9e68c5d5171
https://cdn-avatars.huggingface.co/v1/production/uploads/66309b3833ccd9e68c5d5171/UGt7pZazJHhtwjg0iiyBu.jpeg
Sara Papi
user
spapi
66fe8ce315148a910ce929e2
Luisa Bentivogli
claimed_verified
2025-02-18T16:41:47.711Z
662eb48f5ade870b60db4380
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/ozHyP-GBIAEhR-l-TkBFb.jpeg
Luisa Bentivogli
user
lubentivogli
66fe8ce315148a910ce929e3
Alessio Brutti
claimed_verified
2024-10-03T15:01:43.727Z
66fe8ee6bb54785c355d4549
/avatars/6e2a49b20e1caa6e4005411420845b72.svg
Alessio Brutti
user
AlessioBrutti
66fe8ce315148a910ce929e4
Mauro Cettolo
66fe8ce315148a910ce929e5
Roberto Gretter
66fe8ce315148a910ce929e6
Marco Matassoni
claimed_verified
2024-10-04T08:35:01.157Z
61f244bb88b9b5abbe184a7f
/avatars/ffde1bac886cc5a74c2eedecb3ce33d3.svg
Marco Matassoni
user
matasso
66fe8ce315148a910ce929e7
Mohamed Nabih
claimed_verified
2024-10-04T07:31:50.233Z
659eab38d55b5c4fa49172d7
https://cdn-avatars.huggingface.co/v1/production/uploads/659eab38d55b5c4fa49172d7/b6FHt_DIw2rHfcLumjv4f.png
Mohamed Nabih Ali
user
mnabihali
66fe8ce315148a910ce929e8
Matteo Negri
claimed_verified
2025-02-19T09:06:12.146Z
66350219843f549fdac86347
/avatars/1ad7aa4e8e6d80c5d50bf4de502f11a4.svg
Matteo Negri
user
MNegri
MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation
  Model Training on EU Languages
The rise of foundation models (FMs), coupled with regulatory efforts
addressing their risks and impacts, has sparked significant interest in
open-source models. However, existing speech FMs (SFMs) fall short of full
compliance with the open-source principles, even if claimed otherwise, as no
existing SFM has model weights, code, and training data publicly available
under open-source terms. In this work, we take the first step toward filling
this gap by focusing on the 24 official languages of the European Union (EU).
We collect suitable training data by surveying automatic speech recognition
datasets and unlabeled speech corpora under open-source compliant licenses, for
a total of 950k hours. Additionally, we release automatic transcripts for 441k
hours of unlabeled data under the permissive CC-BY license, thereby
facilitating the creation of open-source SFMs for the EU languages.
Researchers address the lack of compliance with open-source principles in speech foundation models by releasing a multilingual dataset and transcripts to facilitate the creation of EU language-specific open-source models.
foundation models speech foundation models open-source principles training data automatic speech recognition unlabeled speech corpora CC-BY license