{"id":33189,"date":"2021-08-03T16:55:13","date_gmt":"2021-08-03T20:55:13","guid":{"rendered":"https:\/\/www.bu.edu\/cise\/?p=33189"},"modified":"2021-08-24T21:04:08","modified_gmt":"2021-08-25T01:04:08","slug":"self-taught-self-driving-cars","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/cise\/self-taught-self-driving-cars\/","title":{"rendered":"Cars that learn how to drive themselves by watching other cars"},"content":{"rendered":"

Self-driving cars are powered by machine learning algorithms that require vast amounts of driving data in order to function safely. But if self-driving cars could learn to drive in the same way that babies learn to walk\u2014by watching and mimicking others around them\u2014they would require far less compiled driving data. That idea is pushing Boston University engineer Eshed Ohn-Bar to develop a completely new way for autonomous vehicles to learn safe driving techniques\u2014by watching other cars on the road, predicting how they will respond to their environment, and using that information to make their own driving decisions.<\/p>\n

\"\"
CISE faculty affiliate Eshed Ohn-Bar<\/figcaption><\/figure>\n

CISE faculty affiliate Eshed Ohn-Bar<\/a>,\u00a0 a BU College of Engineering assistant professor of electrical and computer engineering and a junior faculty fellow at BU\u2019s Rafik B. Hariri Institute for Computing and Computational Science & Engineering, and Jimuyang Zhang, a BU PhD student in electrical and computer engineering, recently presented their research<\/a> at the 2021 Conference on Computer Vision and Pattern Recognition. Their idea for the training paradigm came from a desire to increase data sharing and cooperation among researchers in their field\u2014currently, autonomous vehicles require many hours of driving data to learn how to drive safely, but some of the world\u2019s largest car companies keep their vast amounts of data private to prevent competition.<\/p>\n

\u201cEach company goes through the same process of taking cars, putting sensors on them, paying drivers to drive the vehicles, collecting data, and teaching the cars to drive,\u201d Ohn-Bar says. Sharing that driving data could help companies create safe autonomous vehicles faster, allowing everyone in society to benefit from the cooperation. Artificially intelligent driving systems require so much data to work well, Ohn-Bar says, that no single company will be able to solve this problem on its own.<\/p>\n

\u201cBillions of miles [of data collected on the road] are just a drop in an ocean of real-world events and diversity,\u201d Ohn-Bar says. \u201cYet, a missing data sample could lead to unsafe behavior and a potential crash.\u201d<\/p>\n

The researchers\u2019 proposed machine learning algorithm works by estimating the viewpoints and blind spots of other nearby cars to create a bird\u2019s-eye-view map of the surrounding environment. These maps help self-driving cars detect obstacles, like other cars or pedestrians, and to understand how other cars turn, negotiate, and yield without crashing into anything.<\/p>\n

Through this method, self-driving cars learn by translating the actions of surrounding vehicles into their own frames of reference\u2014their machine learning algorithm\u2013powered neural networks. These other cars may be human-driven vehicles without any sensors, or another company\u2019s auto-piloted vehicles. Since observations from all of the surrounding cars in a scene are central to the algorithm\u2019s training, this \u201clearning by watching\u201d paradigm encourages data sharing, and consequently safer autonomous vehicles.<\/p>\n

Ohn-Bar and Zhang tested their \u201cwatch and learn\u201d algorithm by having autonomous cars driven by it navigate two virtual towns\u2014one with straightforward turns and obstacles similar to their training environment, and another with unexpected twists, like five-way intersections. In both scenarios, the researchers found that their self-driving neural network gets into very few accidents. With just one hour of driving data to train the machine learning algorithm, the autonomous vehicles arrived safely at their destinations 92 percent of the time.<\/p>\n

\u201cWhile previous best methods required hours, we were surprised that our method could learn to drive safely with just 10 minutes of driving data,\u201d Ohn-Bar says.<\/p>\n

These results are promising, he says, but there are still several open challenges in dealing with intricate urban settings. \u201cAccounting for drastically varying perspectives across the watched vehicles, noise and occlusion in sensor measurements, and various drivers is very difficult,\u201d he says.<\/p>\n

Looking ahead, the team says their method for teaching autonomous vehicles to self-drive could be used in other technologies, as well. \u201cDelivery robots or even drones could all learn by watching other AI systems in their environment,\u201d Ohn-Bar says.<\/p>\n

This story was adapted from the original story published on The Brink, which can be found here<\/a>.<\/span><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Self-driving cars are powered by machine learning algorithms that require vast amounts of driving data in order to function safely. But if self-driving cars could learn to drive in the same way that babies learn to walk\u2014by watching and mimicking others around them\u2014they would require far less compiled driving data. That idea is pushing Boston […]<\/p>\n","protected":false},"author":10316,"featured_media":33193,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[76],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/33189"}],"collection":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/users\/10316"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/comments?post=33189"}],"version-history":[{"count":11,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/33189\/revisions"}],"predecessor-version":[{"id":33948,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/33189\/revisions\/33948"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/media\/33193"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/media?parent=33189"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/categories?post=33189"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/tags?post=33189"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}