- All Categories
- Featured Events
- Alumni
- Application Deadline
- Arts
- Campus Discourse
- Careers
- BU Central
- Center for the Humanities
- Charity & Volunteering
- Kilachand Center
- Commencement
- Conferences & Workshops
- Diversity & Inclusion
- Examinations
- Food & Beverage
- Global
- Health & Wellbeing
- Keyword Initiative
- Lectures
- LAW Community
- Meetings
- Orientation
- Other Events
- Religious Services & Activities
- Special Interest to Women
- Sports & Recreation
- Social Events
- Study Abroad
- Weeks of Welcome
- The Clothesline Project12:00 am
- Body, Mind, Space, and Spirit: Margaret Rigg Art Collection8:00 am
- Sights, Sounds, and Space: Audio-visual Learning in 3D Environments11:00 am
- Boston Theater Marathon XXIII: Special Zoom Edition12:00 pm
- Creative Writing 3:00 pm
- Managing Anxiety3:00 pm
- Interviewing in a Virtual World5:00 pm
- Mindfulness Meditation5:00 pm
- Virtual Hangouts with The Wellbeing Project5:30 pm
- Rachel Dratch Live with BU Hillel: Jewish Comedy and Culture6:00 pm
- Incarcerated Survivor Letter Writing6:30 pm
Sights, Sounds, and Space: Audio-visual Learning in 3D Environments
Moving around in the world is naturally a multisensory experience, but today’s embodied agents are deaf—restricted to solely their visual perception of the environment. We explore audio-visual learning in complex, acoustically and visually realistic 3D environments. By both seeing and hearing, the agent must learn to navigate to a sounding object, use echolocation to anticipate its 3D surroundings, and discover the link between its visual inputs and spatial sound. To support this goal, we introduce SoundSpaces: a platform for audio rendering based on geometrical acoustic simulations for two sets of publicly available 3D environments. SoundSpaces makes it possible to insert arbitrary sound sources in an array of real-world scanned environments. Building on this platform, we pursue a series of audio-visual spatial learning tasks that suggest how audio can benefit visual understanding of 3D spaces.
When | 11:00 am to 12:00 pm on Monday, April 12, 2021 |
---|---|
Location | Zoom Webinar |
Contact Name | Gina Mantica |
Phone | 617-353-7942 |
Contact Email | gmantica@bu.edu |
Contact Organization | Hariri Institute for Computing |
Fees | Free |
Speakers | Kristen Grauman, Professor, Department of Computer Science, the University of Texas at Austin |