M2-1: Intelligent Interaction

Full course description

Elective Module Project 2-1 > M2-1: Intelligent Interaction

Course: Image and Video Processing (period 2) +
Project: Project 2-1 Human-Computer Interaction (semester 3, bachelor year 2)

Each elective module comprises an elective course, an elective project, and related skill classes.

Second year students choose one out of the two electives (Module Project 2-1) during semester 3.

During this project, students will employ advanced video processing techniques to enhance the standard HCI experience. To allow students to quickly move on to the exploitation of contextual information, they will use open-source libraries and code for body gesture tracking (e.g. openpose) or facial expression recognition. This will draw away the emphasis from the technical details regarding the underlying AI models but will teach the students how to handle software development when interfacing with existing code and pre-trained models. The aim will be to build intelligent interfaces instead of accurate AI models. Specific topics that might be interleaved between years include (i) gesture-driven interfaces, i.e., interfaces that can be driven by hand/finger gestures instead of mouse clicks or keyboard commands; (ii) analysis of user interfaces based on eye-gaze tracking; (iii) automatic emotion and/or personality recognition during interaction and personalization, in replacement of personality questionnaires