ELRA ELRA
  Home Catalogue
Language Resources
Bug reports
Send us your bug reports.
Search Catalogue
 
Use keywords to find the product you are looking for.
Advanced Search
Languages
Anglais Français
Informations
  • Purchase procedure & Conditions

  • Pricing & user licences

  • How to promote your resources ?

  • Contact Us
  • Catalog Reference : ELRA-S0280
    SmartWeb Video Corpus (SVC)
    The SMARTWEB UMTS data collection was created within the publicly funded German SmartWeb project in the years 2004-2006. It comprises a collection of user queries to a naturally spoken Web interface with the main focus on the soccer world series in 2006. The recordings include field recordings using a hand-held UMTS device (one person, SmartWeb Handheld Corpus SHC, ref. ELRA-S0278), field recordings with video capture of the primary speaker and a secondary speaker (SmartWeb Video Corpus SVC, ref. ELRA-S0279), as well as mobile recordings performed on a BMW motorbike (one speaker, SmartWeb Motorbike Corpus SMC, ref. ELRA-S0280).

    This multimodal corpus corresponds to the video capture of the primary speaker and a secondary speaker (SmartWeb Video Corpus) and contains 99 recordings each containing a human-human-machine dialogue: one speaker (which is being recorded) interacts with a human partner as well with a dialogue system via a smart phone (SmartWeb system).

    The speaker uses a client-server based dialogue system (SmartWeb) for spoken access to Internet contents in a natural environment (office, hallway, street, park, cafe, etc.). Speech was captured over a Bluetooth headset and transferred via an UMTS cellular line to the server; a second collar attached microphone was captured on a portable iRiver recorder to yield an undisturbed, high quality reference signal. The face of the speaker was captured by the build-in face camera of the smart phone. The speech signal was segmented into queries (automatically by the prompting system) and a second time manually into turns and transcribed according to Verbmobil transliteration standard. The video signal was labelled manually into OnView / OffView and - partly - spatially segmented for face detection.

    The motivation for this corpus was to capture realistic multimodal (speech + face) data in a realistic human machine interaction as well as to capture as many OffTalk situations as possible (OffTalk being all speech uttered by the speaker that is not intended as input to the system).

    The corpus contains:
    - number of dialogues / recorded speakers: 99
    - number of segmented turns: 2,218
    - total duration: 971 minutes
    - formats:
    o collar mic: WAV 44,1kHz, 16 bit
    o Bluetooth/UMTS-channel: ALAW 8kHz 8bit
    o video: 176x144, 24bpp, 15fps, 3GPP + MPEG1
    o Verbmobil Transliteration (TRS), BAS Partitur Format (BPF), ATLAS Annotation Graph (XML)
    o meta data: speaker and recording protocol (XML)
    - segmentation: automatic segmentation into input queries by the prompting system; manual segmentation into turns; OffTalk labelling; OffView labelling, spatially segmentation of face (partly manually)
    - distribution: 5 DVD-R

    See also ELRA-S0278 and ELRA-S0279.

    ISLRN : 874-872-676-146-6
    Production
    Project : SmartWeb Creation date : 2004-2006
    Applications
    Applications existing : Spoken dialogue systems
    Technical Information
    Distribution medium : DVD
    Fileformat : wav
    Contents Click on the arrow to display content.
     speech corpus 
     Video 
     
    Members Prices
    Academic - Commercial 1635.00 EUR
    Academic - Research 635.00 EUR
    Commercial - Commercial 1635.00 EUR
    Commercial - Research 1635.00 EUR
    Non Member Prices
    Academic - Commercial 2275.00 EUR
    Academic - Research 1275.00 EUR
    Commercial - Commercial 2275.00 EUR
    Commercial - Research 2275.00 EUR

    Copyright © 2008 ELRA
    ELRACatalogue 0.8.0