Multi-Modal User Interaction, Fall 2008

Zheng-Hua Tan

Tel: +45 9940-8686

Office: Room A6-319, Niels Jernes Vej 12


Course description:

The course will enable the student to understand and design advanced multi modal user interfaces - including speech based interaction - which is one of the primary  goal of the VGIS programme.


Speech is the most natural means for human-human communication. As computing machines become more and more capable and widespread, there is an increasing demand to include speech as a key component in human-machine interface. This course attempts to provide the students with a basic comprehension of the methods and models applied in speech and multi-modal systems.

Course outline:

  •  Automatic speech recognition and -synthesis

  •  Integration of information from e.g. speech and visual modalities into advanced multimodal interfaces

  • Multi modal interface design and evaluation methods

  •  Architectures and platforms of MM systems


  • McTear, Spoken Dialogue Technology, Springer, 2004.

Lecture notes:

Link to Lecture 6-10 by Lars Bo Larsen.