CS 5678

Topics in Mixed Reality

Course Description

Course information provided by the Courses of Study 2020-2021.

Head-worn mixed reality devices require real-time computer vision for multiple purposes, such as motion tracking, scene understanding, and interaction input. This course presents a hands-on overview of these computer vision techniques for mixed reality, from monocular pose estimation to stereo-view hand tracking, and scene reconstruction with depth sensors and multiple cameras. Fundamental approaches as well as current challenges, from geometric vision to learning-based approaches, are presented in the context of mixed reality, with readings from textbooks and relevant papers. Students will complete three individual assignments and one group project, in the form of mixed reality research prototypes and conference-style report.

When Offered Spring.

Permission Note Enrollment limited to: Cornell Tech students.
Prerequisites/Corequisites Prerequisite: CS 5650, INFO 5340 , or permission from the instructor.

View Enrollment Information