{"id":12981,"date":"2017-11-13T11:10:39","date_gmt":"2017-11-13T16:10:39","guid":{"rendered":"https:\/\/www.bu.edu\/hic\/?p=12981"},"modified":"2021-11-29T08:31:32","modified_gmt":"2021-11-29T13:31:32","slug":"from-vision-to-language-and-back-again","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/hic\/2017\/11\/13\/from-vision-to-language-and-back-again\/","title":{"rendered":"From Vision to Language and Back Again"},"content":{"rendered":"<p><strong><span>Andrei Barbu<\/span>, <span>Research Scientist, Massachusetts Institute of Technology (MIT)<\/span><\/strong><\/p>\n<p><strong>Wednesday, November\u00a015, 1:00-2:00pm; Hariri Institute for Computing (111 Cummington Mall, Boston)<\/strong><\/p>\n<p><strong>Abstract<\/strong>: <span>We will discuss a program to unify research around a number of\u00a0<\/span><span>vision-language problems into a single mathematical framework\u00a0<\/span><span>culminating in a robotic platform that is able to follow natural\u00a0<\/span><span>language commands, store knowledge, and answer questions. Connecting\u00a0<\/span><span>perception and language in diverse real-world settings sheds light on\u00a0<\/span><span>how cognition is structured and can help answer questions about the\u00a0<\/span><span>nature of memory. We will look at near-term extensions of this work to\u00a0<\/span><span>allow robots to introspect, detect failure, and take corrective\u00a0<\/span><span>action.\u00a0<\/span><span>I will also briefly discuss the state of science in computer vision\u00a0<\/span><span>and present a new soon-to-be-released object-detection dataset and new\u00a0<\/span><span>methodology for evaluating computer vision systems.<\/span><\/p>\n<p><strong>Bio<\/strong>: <span>Andrei Barbu is a Research Scientist at MIT in the Computer Science\u00a0<\/span><span>and Artificial Intelligence Laboratory (CSAIL) working on vision,\u00a0<\/span><span>language, robotics, and neuroscience. Dr. Barbu\u2019s research interests\u00a0<\/span><span>focus around how flexible intelligence arises from the integration of\u00a0<\/span><span>perception, communication, and reasoning. Dr. Barbu received his his\u00a0<\/span><span>undergraduate degree from University of Waterloo and PhD from Purdue\u00a0<\/span><span>University.<\/span><\/p>\n<p><strong><a href=\"https:\/\/www.bu.edu\/hic\/centers-initiatives-labs\/air\/\">[Back to AIR Initiative webpage]<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This talk by <strong>Andrei Barbu<\/strong>, a research scientist at MIT, will discuss a program to <strong>unify research around a number of vision-language problems<\/strong> into a single mathematical framework culminating in a robotic platform that is able to follow natural language commands, store knowledge, and answer questions.<\/p>\n","protected":false},"author":8550,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[11785,11771,11748,11747],"tags":[11787],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/12981"}],"collection":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/users\/8550"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/comments?post=12981"}],"version-history":[{"count":5,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/12981\/revisions"}],"predecessor-version":[{"id":24867,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/12981\/revisions\/24867"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/media?parent=12981"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/categories?post=12981"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/tags?post=12981"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}