Innovative Energy Efficiency: Fisheye Cameras in Smart Spaces

Imagine a bustling corporate office building where energy consumption needs to be balanced with maintaining a comfortable environment for employees. In such settings, traditional methods of regulating air handling systems can lead to inefficiencies and waste energy in unoccupied areas. This is where the research of Boston University Professors and CISE affiliates Thomas Little, Janusz Konrad, Prakash Ishwar, and Michael Gevelber is critical.

Professors Little, Konrad, Ishwar, and Gevelber have collaborated on a paper related to their innovative work on smart spaces, energy efficiency, and privacy-conscious solutions. Their paper, “High-accuracy people counting in large spaces using overhead fisheye cameras”, was published in Energy and Buildings on ScienceDirect, a database of peer-reviewed, full-text scientific, technical, and health literature. 

“We aim to reduce HVAC energy use in indoor spaces, particularly commercial ones, by means of improved management of air handling, which requires knowing the number of people,” said Konrad. This system is known as COSSY, or the Computational Occupancy Sensing System.

“The more accurate the count, the better energy savings you’ll get while assuring occupant comfort,” noted Konrad. The system applies artificial intelligence to live images to estimate the number of people in a space. This data is then used to adjust air handling systems dynamically, ensuring energy is not wasted in unoccupied or sparsely-occupied rooms. This process directly addresses the dual challenge of reducing energy consumption while also maintaining a comfortable environment for occupants, which is essential in large commercial and institutional spaces where inefficient energy leads to significant costs and environmental impact.

While COSSY’s primary application is improving energy efficiency in commercial spaces, it has broader potential uses. For instance, it could tailor the built environment where people are located, such as lighting that follows occupants or delivering different spectra of light based on people’s needs at different times of the day. 

Their paper provides a detailed analysis of the technical processes behind COSSY. High- resolution fisheye cameras capture extensive fields of view, enabling accurate occupancy estimates in large or irregularly shaped rooms. One significant challenge in this research is the perception of privacy invasion with cameras. “Even though cameras are everywhere, we recognized this as a problem and specifically designed the system to be self-contained, ensuring that captured images never leave COSSY. We don’t want to look at the images or have anyone else look at the images,” emphasized Konrad. 

Because of  increasing concern over surveillance and potential misuse of personal data, the issue of privacy is critical in this research. With cameras already prevalent in many public and private spaces, individuals are often wary of being constantly monitored, which can lead to discomfort and mistrust. By ensuring that the COSSY system is self-contained and images are not stored or transmitted, the research team has addressed these privacy concerns head-on. This approach not only encourages user acceptance, but sets a standard for ethical considerations in the development of smart technologies. By prioritizing privacy, Professors Little and Konrad have demonstrated that it is possible to harness advanced technologies for societal benefit without compromising individual freedoms. 

Little and Konrad’s scope of research extends beyond the COSSY system, including designing an indoor air-quality sensor network, supported in part by BU’s Campus Climate Lab. This sensor network provides real-time data on classroom air quality, which can be imperative for ensuring a healthy indoor environment. It is also highly customizable, allowing the integration of various sensors and displaying data to occupants in individual classrooms.

“Innovating in impactful areas is rewarding, but as solutions get more complicated, diverse expertise is required, so collaboration becomes essential,” shared Konrad. The publication of research papers serves as validation from peers, affirming the importance, novelty and impact of their work.

“Being a researcher is such an entrenched activity, we all just think about innovating,” Little added. “Innovating in impactful areas is the win and that’s intrinsically satisfying, and it’s why all of us are here.”

CISE Affiliated Faculty Profiles

Thomas Little is a Professor of Electrical and Computer Engineering at Boston University and Associate Dean for Strategic Initiatives in the College of Engineering. He leads the Multimedia Communications Lab where he is active in research on pervasive computing and communications which supports the development of ‘smart spaces’ enabling built environments to anticipate and respond to human needs. 

 Janusz Konrad is a Professor of Electrical and Computer Engineering at Boston University, where he leads the Visual Information Processing (VIP) laboratory. His research interests include computer vision, visual sensor networks, stereoscopic and 3D imaging, image and video processing, and multidimensional digital signal processing.

Prakash Ishwar is a Professor of Electrical and Computer Engineering at Boston University. Professor Ishwar’s research interests include statistical signal processing and machine learning, network information and communications, information security, and visual information processing and analysis.

Michael Gevelber is an Associate Professor of Mechanical Engineering at Boston University. His research interests include modeling and control for advanced materials processing applications and sustainable buildings: electro-spinning of nanofibers, plasma spray, optimization of building HVAC systems and building energy use. Professor Gevelber’s engineering research focuses on developing enhanced materials processing capabilities through modeling, sensor development, experimentation, and integrated system and control design.