{"id":37177,"date":"2022-09-16T14:24:00","date_gmt":"2022-09-16T18:24:00","guid":{"rendered":"https:\/\/www.bu.edu\/cise\/?p=37177"},"modified":"2023-04-24T11:53:36","modified_gmt":"2023-04-24T15:53:36","slug":"powerful-updates-to-novel-computational-imaging-device-featured-in-optica","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/cise\/powerful-updates-to-novel-computational-imaging-device-featured-in-optica\/","title":{"rendered":"Powerful Updates to Novel Computational Imaging Device Featured in Optica"},"content":{"rendered":"

Prof. Lei Tian (ECE, BME) and his team, led by PhD students, Yujia Xue (PhD, ECE, 2022) and Qianwan Yang (PhD student, ECE) published their paper \u201c<\/span>Deep-learning-augmented Computational Miniature Mesoscope\u201d<\/span> that describes advances to their Computational Miniature Mesoscope (CM2<\/sup><\/span>) project. This paper, published in the prestigious journal <\/span>Optica<\/span><\/i><\/a>, presents the CM2 \u00a0<\/sup><\/span>V2, a more powerful CM2<\/sup><\/span> technology. The most recent developments have been supported by a $2 million R01 grant from the National Institutes of Health.<\/span><\/p>\n

\"\"
Lei Tian (ECE, BME), Qianwan Yang (PhD student, ECE), and Yujia Xue (PhD, ECE, 2022)<\/figcaption><\/figure>\n

Fluorescence microscopy is key to study biological interactions such as neural activities, gene expression, and molecular interactions. Because the CM2<\/sup><\/span>\u00a0aims to <\/span>be applied for studying freely moving animals, researchers who use the device can collect biological data in more native states. This data may help researchers study animal behavior patterns, understand their brain functions, and identify how these functions occur.\u00a0<\/span><\/p>\n

Tian is the head of the <\/span>Computational Imaging Systems Laboratory (CISL)<\/span><\/a> and a faculty affiliate of the Hariri Institute of Computing and the Center for Information and Systems Engineering. He has been developing the Computational Miniature Mesoscope (CM2<\/sup><\/span>) since 2018 along with co-investigators Professor David Boas (BME, ECE, Director of the Neurophotonics Center) and Associate Professor Ian Davison (BIO). They were initially supported by the Dean\u2019s Catalyst award and a BRAIN initiative R21 grant\u00a0 through the project\u2019s developments in <\/span>2022<\/span><\/a> and <\/span>2020<\/span><\/a>, respectively.\u00a0<\/span><\/p>\n

This CM2<\/sup><\/span>\u00a0synergistically combines optics and algorithms by using the computational imaging framework to overcome the limitations on conventional fluorescence microscopy. The CM2<\/sup><\/span>\u00a0prototype combines the merits of both the light field imaging and lenless designs. It attaches a microlens array to an CMOS sensor to capture the sharp high quality images of the sample from different viewpoints.\u00a0 This produced a multiplexed measurement with overlapping views so the 3D fluorescence information could be computationally reconstructed in a single shot.<\/span><\/p>\n

Tian\u2019s recent paper details that the updated device has an added hybrid emission filter and a miniature collimator to significantly improve the image contrast and light efficiency. The filter suppresses spectral leakage and improves the contrast in the imaging, and the collimator helps collect the light at a broad angle and illuminate the entire mapped area uniformly. This freeform LED collimator, printed and designed by Tian\u2019s team, achieves ~80% light efficiency, three times more than the first version.<\/span> These updates also achieve a 5x improvement in image contrast and capture a higher quality\u00a0 image with a higher signal to noise ratio.<\/span><\/p>\n

\"\"
Overview of the computational miniature mesoscope (CM2)<\/figcaption><\/figure>\n

The other crucial aspect of this device is CM2<\/sup><\/span>Net, a deep learning model that achieves high-quality 3D reconstruction across a wide FOV and significantly improved axial resolution and reconstruction speed. Deep Learning has emerged as a state of the art technology for solving inverse problems in imaging because it provides fast, high resolution reconstruction and it is time and memory efficient. This deep learning framework uses three modules: View-demixing, view-synthesis, and lightfield refocusing enhancement. View-demixing separates the single measurement into 3×3 non-overlapping views by<\/span> exploring the differences and rejecting the overlaps in the single shot.<\/span> View-synthesis finds the depth-dependent disparities and reconstructs the 3D volume, while lightfield refocusing (LFR) enhancement modules use the LFR algorithm to estimate volume, and then enhance, clarify, and match the sample resolution.<\/span><\/p>\n

This deep learning framework shows potential to provide a high-resolution, 3D reconstruction of the entire mouse cortex and brain vessel networks, and enhances the axial resolution by 8 times that of the traditional model-based reconstruction. The novel 3D reconstruction provides nearly uniform detection performance across the whole field-of-view and is ~1400 times faster and uses ~19 times fewer memory cost than model-based algorithms. This simple and low cost device can be applied in a wide range of large-scale 3D fluorescence imaging and neural recordings.<\/span><\/p>\n

Learn more about Professor Tian and his students\u2019 work to develop computational imaging methods <\/span>here<\/span><\/a>.<\/span><\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

Prof. Lei Tian (ECE, BME) and his team, led by PhD students, Yujia Xue (PhD, ECE, 2022) and Qianwan Yang (PhD student, ECE) published their paper \u201cDeep-learning-augmented Computational Miniature Mesoscope\u201d that describes advances to their Computational Miniature Mesoscope (CM2) project. This paper, published in the prestigious journal Optica, presents the CM2 \u00a0V2, a more powerful […]<\/p>\n","protected":false},"author":18605,"featured_media":37184,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[76],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/37177"}],"collection":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/users\/18605"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/comments?post=37177"}],"version-history":[{"count":18,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/37177\/revisions"}],"predecessor-version":[{"id":38735,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/37177\/revisions\/38735"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/media\/37184"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/media?parent=37177"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/categories?post=37177"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/tags?post=37177"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}