Multimodal User Interfaces (MBO)

SWS	2 / 2 / 0 (Lectures / Exercises / Practical Part)
Availability	Summer Term
Programme	Media Computer Science / Computer Science / Information System Technology
Subject	System-Oriented Computer Science / Software Technology / Development Methods and Tools
Modules	_{Master and Diploma Computer Science:} INF-VERT1, INF-VERT3, INF-PM-ANW _{Master Media Computer Science:} INF-E-3, INF-VMI-10 _External: _{D-WW-INF-3402, D-WW-INF-3403, D-WW-INF-3411, D-WW-INF-3412, D-WW-INF-3413, INF-04-FG-SOI, INF-LE-WW, IST-05-FG-SOI, MINF-04-FG-EMW, WI-MA-08-02, WI-MA-08-03, WI-MA-09-02, WI-MA-09-03}
Lecturer	Prof. Dr. rer. nat. habil. Gerhard Weber
Contact Person	Chair Secretary
Enrolment	via OPAL

The lecture Multimodal User Interfaces addresses students of the computer science programmes as well as students who deal with the design of multimodal user interfaces or are interested in the integration of various input techniques. The course starts by presenting the requirements of multimodal systems to sync in- and output media as well as the XML language EMMA, referring to the architecture of web-based multimodal user interfaces.

Several topics of multimodal interaction are:

Voice dialogues (using digital voice assistants such as Siri or Alexa) as well as techniques to recognise or synthesise speech
Sound creation (Sonification)
Audio
Multitouch gestures and their recognition
Haptics and Force Feedback

This course builds upon the course Human-Computer Interaction (MCI). During the tutorials, real solutions are implemented (e.g. Alexa Skills).

Place and Time

Summer 2025

Information regarding hybrid lectures will follow soon. The course will be organized online in the first place.

Lecture probably Tue. 4th DS 13:00 - 14:30, APB/E001
Tutorial probably Wed. 2nd DS 09:20 - 10:50, APB/E007

Course Material

Further information on exercises and lecture dates is available online via OPAL when the course is open for enrolment.

MBO Couse on OPAL (Summer Term 2025) (enrolment open from 24.03.2025)

Enrolment

Please enrol via OPAL.

Exam

The oral exam will take place in presence.

Exam Registration

Please mind the regulations given by your examination office. Regarding the Computer Science Examination Office, please consider using the online assistant for submitting your exam registration.

Online Assistant for Exam Registration

Information about mental health

The vocational training or qualification phase during the transition from school to later working life is a crucial and sensitive period. Therefore, pay attention to your mental health, especially in challenging situations such as exam periods or approaching deadlines. As a starting point, please feel free to use our resources on mental health (Mental Health First Aid, MHFA) available in OPAL.

OPAL course on mental health.

Multimodal User Interfaces (MBO)

Table of contents

Contents