1. The AMI Meeting Corpus: A Pre-Announcement
Jean Carletta
MLMI-05

2. AMI Partners

3. AMI Overview
Development of technology to support human interaction in meetings, through meeting browsers and online meeting assistants for multi-modal meeting recordings. Requires:
requirements and evaluation specialists
organizational psychologists
linguists who study groups
signal processors
computational linguists

4. Motivation Technological advancement must be driven by data that
is plentiful
admits effectiveness measurement
has been well-recorded on all modalities
has been annotated for things that get us from signal to what the users need
is realistic

5. Why elicitation? Limit the domain
makes it possible to build ontologies
understand what's going on
Control knowledge and motivation of participants
Makes it easier to get zero-history groups
Build in outcome measures

6. AMI Hub Corpus Goal: 100 hours of 4 participant meetings
60% arising from a carefully designed elicitation task
remaining 40% from a variety of genres and increasingly real
find out where our methods and results generalize
find out where they don't

7. Elicitation task
task: design a remote control in and around four meetings using normal office software
roles: project manager, marketing expert, interface designer, industrial designer
different training at start of day
different feedback from organization throughout
phases: project kick-off, functional design, conceptual design, detailed design
effectiveness and teamworking measurement throughout the day

9. AMI Meeting Rooms
4 close- and 2 wide-view cameras, 4 head-set and 8 array microphones, presentation screen capture, whiteboard capture, pen devices, plus extra site-dependent devices
TNO
Edinburgh
IDIAP

10. 48 kHz 16 bit Audio Focusrite Octopre Focusrite Octopre
Microphone arrays
MOTU 2408 MK3
Focusrite Octopre
Focusrite Octopre
Focusrite Octopre
48kHz Word Clock
ASP2 Aerial Splitter
MTC
ASP2 Aerial Splitter
MOTU Midi Timepiece AV
60 Hz Blackburst
Receivers X8
Horita BG-50 PAL

11. 280Kbps DivX-encoded Video
(Mini DV recorders)
Longitudinal time code
Timecode Inserter
Timecode Inserter
Timecode Inserter
Timecode Inserter
Timecode inserter
Timecode inserter
MOTU Midi Timepiece AV
60 Hz Blackburst
Sony DC700
Sony DC700
Sony DC700
Sony DC700
Sony SSC-DC58 AP
(Wide angle cameras)
Horita BG-50 PAL
Sony XC555 (close up cameras)

12. Sample camera views (Edinburgh)

13. Annotations timestamping against signal
emotion coding; head gestures; hand gestures focusing on addressing and interactions with objects; location in room; gaze
orthographic transcription with word-level timings derived by forced alignment
discourse structure over orthography
dialogue acts w/ addressing, named entities, topic segments, decision phases, extractive summaries linked to participant abstractive summaries