{"id":137728,"date":"2023-03-13T12:58:21","date_gmt":"2023-03-13T16:58:21","guid":{"rendered":"http:\/\/www.bu.edu\/eng\/?p=137728"},"modified":"2023-08-18T13:52:13","modified_gmt":"2023-08-18T17:52:13","slug":"baillieul-bioinspired-control-systems","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/eng\/2023\/03\/13\/baillieul-bioinspired-control-systems\/","title":{"rendered":"Learning From Animal Behaviors to Inform Control Systems"},"content":{"rendered":"<p><strong>By Margo Stanton<\/strong><\/p>\n<figure id=\"attachment_118770\" aria-describedby=\"caption-attachment-118770\" style=\"width: 194px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" src=\"\/eng\/files\/2022\/06\/john.baillieul.png\" alt=\"\" class=\"wp-image-118770\" width=\"184\" height=\"184\" srcset=\"https:\/\/www.bu.edu\/eng\/files\/2022\/06\/john.baillieul.png 600w, https:\/\/www.bu.edu\/eng\/files\/2022\/06\/john.baillieul-150x150.png 150w, https:\/\/www.bu.edu\/eng\/files\/2022\/06\/john.baillieul-300x300.png 300w, https:\/\/www.bu.edu\/eng\/files\/2022\/06\/john.baillieul-550x550.png 550w, https:\/\/www.bu.edu\/eng\/files\/2022\/06\/john.baillieul-100x100.png 100w\" sizes=\"(max-width: 184px) 100vw, 184px\" \/><figcaption id=\"caption-attachment-118770\" class=\"wp-caption-text\">CISE Affiliate and Distinguished Professor of Engineering John Baillieul (ME, ECE, SE)<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">You may be familiar with the term \u201cblind as a bat\u201d, which is used to describe someone who has poor eyesight. However, recent research on animal behavior by CISE affiliate and Distinguished Professor of Engineering <a href=\"https:\/\/www.bu.edu\/eng\/profile\/john-baillieul-ph-d-me-se\/\" target=\"_blank\" rel=\"noopener noreferrer\">John Baillieul<\/a> (ME, ECE, SE) found that this phrase is a misconception and many species of bats rely on visual perception for navigation. While echolocation is a primary sensory modality for most bat species, for some species, in free flight, vision is used together with echolocation as secondary backup when they\u2019re alarmed or to confirm visual cues. Ballieul\u2019s research largely centers around learning from animal behaviors, like bat navigation, and applying the findings to control systems.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThis research questions how animals operate and how you might use animal behaviors to design control systems,\u201d Professor Ballieul explains. \u201cWe are interested in understanding how the brain and neuromuscular systems, which have been refined by nature, work and using these insights as new models to think about control.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Baillieul began investigating bio-inspired navigation as an investigator on a number of projects funded by the Office of Naval Research (ONR), which has been driving research behind animal-inspired control systems for the last few decades.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In 2010, Ballieul was PI on the five-year, $7.5 million ONR Multidisciplinary University Research Initiative (MURI) project titled <\/span><i><span style=\"font-weight: 400;\">Animal Inspired Flight with Outer and Inner Loop Strategies<\/span><\/i><span style=\"font-weight: 400;\">\u00a0(AIRFOILS). In collaboration with researchers at the University of Washington, the University of Maryland, and the University of North Carolina at Chapel Hill, Ballieul and the team researched the flight capabilities of bats to translate across a range of environments. AIRFOILS aimed to translate these biological capabilities into navigation strategies for flight vehicles.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Building on those discoveries, Ballieul is now a Co-PI on the current ONR MURI grant entitled <\/span><i><span style=\"font-weight: 400;\"><a href=\"https:\/\/sites.bu.edu\/neuroautonomy\/\" target=\"_blank\" rel=\"noopener noreferrer\">Neuro-Autonomy: Neuroscience-Inspired Perception, Navigation, and Spatial Awareness for Autonomous Robots<\/a>, <\/span><\/i><span style=\"font-weight: 400;\">led by PI Professor Yannis Paschalidis, Director, Rafik B. Hariri Institute for Computing and Computational Science &amp; Engineering, Distinguished Professor of Engineering (ECE, SE, BME), Founding Member and Faculty (CDS). The project takes advantage of neurophysiological characteristics in living organisms to establish next-generation perception and navigation in AVs. <\/span><span style=\"font-weight: 400;\">Neuro-Autonomy<\/span><span style=\"font-weight: 400;\"> researchers are analyzing the visual perception of different living organisms and then developing algorithmic methods to apply them to neuro-inspired autonomous robots for land, air, and sea usage. The goal is to create autonomous vehicles (AVs) that can respond quickly to changes in the environment, similar to living organisms.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This past May, Baillieul<\/span><span style=\"font-weight: 400;\"> published a paper with his students Chiara Boretti, Philippe Bich and Yanyu Zhang, entitled <\/span><span style=\"font-weight: 400;\">\u201c<\/span><a href=\"https:\/\/ieeexplore.ieee.org\/document\/9812032\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-weight: 400;\">Visual Navigation Using Sparse Optical Flow and Time-to-Transit<\/span><\/a><span style=\"font-weight: 400;\">\u201d. This paper seeks to understand different visual cues, like binocular vision, and develop computer codes to utilize them.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cIn the case of binocular flow, there\u2019s a parallax that the brain senses while integrating and registering the images from the left and right eyes,\u201d says Baillieul. \u201cAgain, like with the bats, we\u2019re trying to understand how these visual cues play together to give organisms reliable navigation.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Recent hardware developments, like AVs, have increased research interests in optical flow for navigation. Researchers are currently working with new robots and hardware that will be able to experiment with more visual cues, like binocular vision, and explore how to integrate them. Human and animal brains are naturally wired to utilize these visual perceptions. For researchers trying to integrate robots with neuro-autonomous visual perceptions, they have to work on one motion primitive at a time.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cDifferent visual perceptions are used depending on the setting, whether you\u2019re walking through a field or down a hallway,\u201d Baillieul explains. \u201cWhat we\u2019re trying to do is put things together in a coherent way so control software can switch seamlessly between visual\u00a0 perceptual modalities as they traverse different environments.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Baillieul\u2019s work emphasizes the information aspect of control systems and how the brain integrates different sensory modalities from visual sensing to vestibular feedback to inform navigation. This is seen in his work with bats, which transition from navigating using eyesight to utilizing both visual perception and echolocation. As he delves further into this work, Baillieul aims to research how different regions of the brain are involved in this and the role that memory plays in animal movement.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Baillieul has an extensive history of working with Department of Defense agencies. In 2007, Baillieul, working with Professor David Casta\u00f1on, received a MURI grant from the Air Force for the \u201c<\/span><i><span style=\"font-weight: 400;\">Behavioral Dynamics in the Cooperative Control of Mixed Human\/Robotic Teams\u201d<\/span><\/i><span style=\"font-weight: 400;\"> project to study the dynamics of mixed teams, made up of both humans and robots. At the time, the Air Force was moving to replace one-third of its manned air vehicles with robotic UAVs, and understanding the relationships between humans and robots was critical to this goal.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cAs machines became more intelligent, research began questioning how to utilize the intelligence in a way that is going to be naturally adopted by people,\u201d says Baillieul. \u201cAcceptance by users is extremely important and as we go forward the question has become how much autonomy should a vehicle have.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">John Baillieul is a Distinguished Professor of Engineering and co-founder of the Boston University Center for Information and Systems Engineering (<a href=\"https:\/\/www.bu.edu\/cise\/\" target=\"_blank\" rel=\"noopener noreferrer\">CISE<\/a>). He is a Professor of Mechanical Engineering, a Professor of Electrical and Computer Engineering, and a Professor of Systems Engineering. His focus is on robotics, the control of mechanical systems, and mathematical system theory. Professor Baillieul is a past Editor-in-Chief of the IEEE Transactions on Automatic Control. He is an IEEE Fellow for contributions to nonlinear control theory, robotics, and the control of complex mechanical systems. He is also a Fellow of SIAM and a Fellow of IFAC.\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Research by Distinguished Professor of Engineering John Bailleul questions how animals operate and how you might use animal behaviors to design control systems.<\/p>\n","protected":false},"author":10316,"featured_media":137730,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[236,257,240,907,1064,252,908,239,910],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/137728"}],"collection":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/users\/10316"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/comments?post=137728"}],"version-history":[{"count":8,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/137728\/revisions"}],"predecessor-version":[{"id":143193,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/137728\/revisions\/143193"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/media\/137730"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/media?parent=137728"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/categories?post=137728"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/tags?post=137728"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}