{"id":80950,"date":"2019-01-23T15:09:30","date_gmt":"2019-01-23T19:09:30","guid":{"rendered":"http:\/\/www.bu.edu\/eng\/?p=80950"},"modified":"2024-03-07T10:47:54","modified_gmt":"2024-03-07T15:47:54","slug":"seeing-around-corners","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/eng\/2019\/01\/23\/seeing-around-corners\/","title":{"rendered":"Seeing around Corners"},"content":{"rendered":"<h2>A new algorithm extracts enough information from a dull shadow to recreate a hidden scene<\/h2>\n<p><em>By Liz Sheeley<\/em><\/p>\n<p>Seeing through walls or around corners has long been categorized as an unrealistic a super-human power like mind-reading and invisibility. To be able to know what is in a room without directly looking into it is a goal and area of research called non-line-of-sight vision. Until now, the only techniques that have been able to solve this problem aren\u2019t easily translatable to the field. Associate Professor Vivek Goyal (ECE) and his team have developed a method of seeing around corners that uses just a simple digital camera and their custom-built algorithms. Their work has been published in <a href=\"https:\/\/www.nature.com\/articles\/s41586-018-0868-6\"><em>Nature<\/em><\/a>.<\/p>\n<p>\u201cNon-line-of-sight optical imaging techniques like this one could be very useful for search and rescue teams, emergency response and autonomous vehicles,\u201d says Goyal. \u201cIf these techniques can be reasonably easy to deploy then they could be carried around by first responders.\u201d<\/p>\n<p>Goyal\u2019s research has focused on using very small amounts of information, like a weak light signal, to extract much more information than seems possible. In this paper, Goyal, postdoctoral fellow John Murray-Bruce (ECE) and doctoral student Charles Saunders (ECE), built a way to extract a full-color 2D picture of a scene from a photograph of indistinct shadows, known as a penumbrae, on a neighboring wall as shown in the figure below.<\/p>\n<hr \/>\n<figure id=\"attachment_80947\" aria-describedby=\"caption-attachment-80947\" style=\"width: 1034px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" src=\"\/eng\/files\/2019\/01\/figure_1-1024x623.png\" alt=\"\" width=\"1024\" height=\"623\" class=\"wp-image-80947 size-large\" srcset=\"https:\/\/www.bu.edu\/eng\/files\/2019\/01\/figure_1-1024x623.png 1024w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/figure_1-636x387.png 636w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/figure_1-768x468.png 768w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/figure_1-1536x935.png 1536w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/figure_1-2048x1247.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption id=\"caption-attachment-80947\" class=\"wp-caption-text\">A representation of how the photograph of the penumbra is taken. Image courtesy of Nature.<\/figcaption><\/figure>\n<hr \/>\n<p>Currently, their technique only works when an object on known shape is blocking the scene in question. But compared to other techniques, this requires fewer situational necessities.<\/p>\n<p>Murray-Bruce and Saunders say that most of the methods before this one use lasers shine light onto a visible surface in the hidden area, and then\u00a0use the light that\u2019s reflected back from the lasers to reconstruct an image of that area.<em>\u00a0<\/em>Those techniques are called time-of-flight methods. And although the groundwork has been laid to use these types of techniques to recreate a color image, it hasn\u2019t been done yet. The researchers would need color lasers, and to shine each color separately, collect that information, and then reconstruct the image.<\/p>\n<figure id=\"attachment_80964\" aria-describedby=\"caption-attachment-80964\" style=\"width: 908px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" src=\"\/eng\/files\/2019\/01\/Pages-from-supplementary-898x1024.png\" alt=\"\" width=\"898\" height=\"1024\" class=\"wp-image-80964 size-large\" srcset=\"https:\/\/www.bu.edu\/eng\/files\/2019\/01\/Pages-from-supplementary-898x1024.png 898w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/Pages-from-supplementary-558x636.png 558w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/Pages-from-supplementary-768x876.png 768w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/Pages-from-supplementary-1347x1536.png 1347w, https:\/\/www.bu.edu\/eng\/files\/2019\/01\/Pages-from-supplementary-1796x2048.png 1796w\" sizes=\"(max-width: 898px) 100vw, 898px\" \/><figcaption id=\"caption-attachment-80964\" class=\"wp-caption-text\">Reconstructed images (right) of hidden scenes (left) extracted from penumbra photographs (center). Image courtesy of Nature<\/figcaption><\/figure>\n<p>There\u2019s another non-line-of-sight technique that does not involve lasers, but does require the occluding object to move within the scene. This new method does not require calibration, controlled lighting, time-of-flight detection or scene motion; it takes under a second to snap the image, or multiple images, and about 20 minutes to recreate the scene in full color.<\/p>\n<p>\u201cWeak signals buried in a lot of noise are important and useful,\u201d says Goyal. \u201cThere is a universality to shadows that can be exploited to extract a lot of important information, even in low-light scenarios.\u201d<\/p>\n<p>Although they have to know the shape of the occluding object to recreate the scene, they don\u2019t need to know where the object is. They can learn that information while also recreating the scene. And, if there is motion within the scene while the photos of the penumbra are being snapped, they can recreate an even more accurate picture.<\/p>\n<p>Goyal believes that his group\u2019s and time-of-flight methods are complementary. Future research will look at how to combine both sets of principles to further advance non-line-of-sight vision.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Associate Professor Vivek Goyal (ECE) and his team have developed a method of seeing around corners that uses just a simple digital camera and their custom-built algorithms.<\/p>\n","protected":false},"author":13786,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[236,257,240,907,1067],"tags":[519],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/80950"}],"collection":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/users\/13786"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/comments?post=80950"}],"version-history":[{"count":1,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/80950\/revisions"}],"predecessor-version":[{"id":131260,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/80950\/revisions\/131260"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/media?parent=80950"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/categories?post=80950"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/tags?post=80950"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}