AIR Series: First-Person Perception by Anticipating the Unseen and Unheard

AIR SEMINAR SERIES

Kristen Grauman, University of Texas at Austin

This talk has been canceled and will be rescheduled to a later date.

When:
Monday, April 1, 2019
Event Start Time: 11:00 am (reception at 10:30am, talk at 11am)
Event End Time: 12:00 pm

Where:
Kilachand Center, Colloquium Room 101

Abstract: Computer vision has seen major success in learning to recognize objects from massive “disembodied” Web photo collections labeled by human annotators. Yet cognitive science tells us that perception develops in the context of acting the world–and without intensive supervision. Meanwhile, many realistic vision tasks require not only categorizing a well-composed human-taken photo but also actively deciding where to look in the first place. In the context of these challenges, we are exploring how machine perception benefits from anticipating the sights and sounds an agent will experience as a function of its own actions. Based on this premise, we introduce methods for learning to look around intelligently in novel environments, learning from video how to interact with objects, and perceiving audio-visual streams for both semantic and spatial context.

Bio: Kristen Grauman is a Professor in the Department of Computer Science at the University of Texas at Austin and a Research Scientist at Facebook AI Research. Her research in computer vision and machine learning focuses on visual recognition and search. Before joining UT Austin in 2007, she received her Ph.D. at MIT. She is an AAAI Fellow, a Sloan Fellow, and a recipient of the NSF CAREER, ONR YIP, PECASE, PAMI Young Researcher award, and 2013 IJCAI Computers and Thought Award. She and her collaborators were recognized with best paper awards at CVPR 2008, ICCV 2011, ACCV 2016, and a 2017 Helmholtz Prize “test of time” award. She served as Program Chair of the Conference on Computer Vision and Pattern Recognition (CVPR) in 2015 and Neural Information Processing Systems (NeurIPS) in 2018, and she currently serves as Assoc. Editor-in-Chief for the Transactions on Pattern Analysis and Machine Intelligence (PAMI).