Multimodal Minds: Language, Gesture & Sign for Human and Non-Human Interaction

About

Explore how speech, gesture, and sign languages shape meaning and cognition in interaction. You will engage with theoretical frameworks and empirical methods for analyzing multimodal communication, focusing on how visual signals interact with cognitive processes in real-world contexts, also including emerging applications of multimodal AI.

Course leader

Ezgi Mamus and Anita Slonimska

Target group

Bachelor, Advanced Bachelor, Master, PHD, Postdoc, Professional

Course aim

1. Understand how speech, gesture, and sign jointly contribute to meaning, cognition, and interaction in human and artificial systems.
2. Use theoretical frameworks to analyze the structure and function of multimodal communication in discourse.
3. Collect, annotate, and interpret multimodal data using publicly available tools for studying multimodal communication.

Fee info