Distinguished CS Colloquium Talk by Prof. Kristen Grauman on Dec 4th

Speaker: Kristen Grauman

Talk Title: “First-person video understanding”

Abstract: First-person or “egocentric” perception requires understanding the video that streams to a wearable camera. The egocentric view offers a special window into the camera wearer’s attention, goals, and interactions, making it an exciting avenue for the future of augmented reality and robot learning. This talk will describe our AI research group’s recent explorations for multimodal perception, such as vision-language embeddings that inject semantics from text into powerful video representations, audio-visual video models that can anticipate the sounds of human actions or augment a user’s hearing in busy places, and models that can facilitate learning new skills from “how-to” videos. I’ll also overview how we are advancing the frontier of egocentric perception for the broader community via large-scale open-sourced datasets called Ego4D and Ego-Exo4D---multi-year, multi-institutional efforts to capture daily-life and skilled activity of people around the world.

Bio: Kristen Grauman is a Professor in the Department of Computer Science at the University of Texas at Austin and a Research Director in Meta’s Fundamental AI Research lab (FAIR).

Back to Calendar