ELRA - ELRA-E0012 : TC-STAR 2006 Evaluation Package - ASR Spanish

Home Catalogue

Language Resources

Bug reports

Send us your bug reports.

Search Catalogue

Languages

Informations

Purchase procedure & Conditions

Pricing & user licences

How to promote your resources ?

Catalog Reference : ELRA-E0012

TC-STAR 2006 Evaluation Package - ASR Spanish - CORTES

TC-STAR is a European integrated project focusing on Speech-to-Speech Translation (SST). To encourage significant breakthrough in all SST technologies, annual open competitive evaluations are organized. Automatic Speech Recognition (ASR), Spoken Language Translation (SLT) and Text-To-Speech (TTS) are evaluated independently and within an end-to-end system.

The second TC-STAR evaluation campaign took place in March 2006.
Three core technologies were evaluated during the campaign:
• Automatic Speech Recognition (ASR),
• Spoken Language Translation (SLT),
• Text to Speech (TTS).

Each evaluation package includes resources, protocols, scoring tools, results of the official campaign, etc., that were used or produced during the second evaluation campaign. The aim of these evaluation packages is to enable external players to evaluate their own system and compare their results with those obtained during the campaign itself.

The speech databases made within the TC-STAR project were validated by SPEX, in the Netherlands, to assess their compliance with the TC-STAR format and content specifications.

This package includes the material used for the TC-STAR 2006 Automatic Speech Recognition (ASR) second evaluation campaign for Spanish. The same packages are available for English (ELRA-E0011), Mandarin (ELRA-E0013), and for the EPPS task for Spanish (ELRA-E0012/02), for ASR and for SLT in 3 directions, English-to-Spanish (ELRA-E0014), Spanish-to-English (ELRA-E0015), Chinese-to-English (ELRA-E0016).

To be able to chain the components, ASR, SLT and TTS evaluation tasks were designed to use common sets of raw data and conditions. Three evaluation tasks, common to ASR, SLT and TTS, were selected: EPPS (European Parliament Plenary Sessions) task, CORTES (Spanish Parliament Sessions) task and VOA (Voice of America) task. The CORTES data were used in addition to the EPPS data to evaluate ASR in Spanish and SLT from Spanish into English.

This package was used within the CORTES task and consists of 2 data sets:
- Development data set: consists of audio recordings of CORTES’ sessions from 1 to 2 December 2004, manually transcribed. 3 hours of recordings were selected and transcribed, corresponding to approximately 30,000 running words in Spanish.
- Test data set: consists of audio recordings of CORTES’ sessions of 24 November 2005, As for the development set, the test data set is made of 3 hours (30,000 running words).

Production

Project : TC-STAR

Applications

Applications existing : Automatic speech recognition

Technical Information

Distribution medium : DVD

Contents

Click on the arrow to display content.

speech corpus
Language(s) : Spanish, Castilian
TEXT_DURATION3 hours for development data set and 3 hours for test data set
Source Channel : Microphone

Resource files

Validation report - CORTES

Members Prices

Academic - Evaluation 500.00 EUR

Commercial - Evaluation 500.00 EUR

Non Member Prices

Academic - Evaluation 750.00 EUR

Commercial - Evaluation 750.00 EUR

Special Prices

Special prices:
- 2006 ASR Suite (E0011 + E0012 + E0013):
Evaluation use by ELRA members: 1200
Evaluation use by non members: 1800

- 2006 SLT Suite (E0014 + E0015 + E0016)
Evaluation use by ELRA members: 1200
Evaluation use by non members: 1800

- 2006 ASR + SLT Suites (E0011 + E0012 + E0013 + E0014 + E0015 + E0016):
Evaluation use by ELRA members: 2000
Evaluation use by non members: 3000

- 2005 + 2006 ASR + SLT Suites (E0002 + E0003 + E0004 + E0005 + E0006 + E0007 + E0011 + E0012 + E0013 + E0014 + E0015 + E0016):
Evaluation use by ELRA members: 3200
Evaluation use by non members: 4800