Multimodal Human Machine Interaction, LING 86300 at the Graduate Center, CUNY

This is the course website of LING 86300 (Multimodal Human Machine Interaction) at the Graduate Center, CUNY for Spring 2016. It is intended to act as a repository for class content, including presentations, readings, and projects.

 

A multimodal user interface for devices requires the integration of several recognition technologies together with a sophisticated user interface and distinct tools for input and output of data. Multimodal interaction provides the mobile user with new complex multiple modalities for interfacing with a system, including speech, gestures and movements, touch, typing, and more.

 

This course discusses the new world of multimodality user interfaces, the technologies and design which allow for the creation of innovative and state-of-the-art user interfaces. We will discuss the commercial challenges that come with this technology, and try to offer new approaches to these issues. The objective of the course is to expose the students to state-of-the-art multimodal user interface technologies and to have them face design challenges so they will become familiar with the areas of mobility and multimodality from both the technological and the usability aspect.

 

Student will be required to suggest and design the architecture and dialog flow for a multimodal application. The design plan will be made using the tools and best practices acquired in the class.