![\"\"](\"\/hic\/files\/2021\/05\/photo-Ishwar-636x636.png\")
Artificial Intelligence Research Initiative<\/a> affiliates Janusz Konrad and Prakash Ishwar, along with PhD student Ozan Tezcan, developed a supervised deep learning algorithm that automatically finds changes in a video even in complex scenarios that don\u2019t exist in the dataset that the algorithm is trained on. The algorithm can be used as the first step in more complex computer vision and video processing tasks to allow real-time object classification and tracking. Their findings were recently published in IEEE Access<\/em><\/a>.<\/p>\n The ability of a computer to detect meaningful changes in a video happens through a process called background subtraction. \u201cIn Computer Science, background subtraction is an ancient and well-researched problem,\u201d said Konrad. Early methods assumed a single background and \u201csubtracted\u201d it from the current video frame, but this approach works only in the simplest scenarios. In more complex videos, the backgrounds of videos are difficult to determine. For example, many background subtraction methods cannot determine accurately whether a car stopping on the road for several minutes or the leaves of trees swaying in the wind should be considered as part of the background.<\/p>\n To improve how well the algorithm detects changes in videos, Tezcan not only used many different types of video backgrounds to train the algorithm, but also multiple versions of the same background. Videos of highways, parks, offices, homes, and parking lots were altered to increase the amount of data used to train the algorithm. \u201cWe used a process called data augmentation, where we create new data from an existing dataset<\/a>. We transformed videos to create pan effects, tilts, and zooms,\u201d said Ishwar. The researchers also changed the lighting and chose videos taken in different weather conditions to diversify their dataset further. Training the algorithm on these \u201caugmented backgrounds\u201d, as Tezcan put it, is what makes their algorithm, BSUV-Net 2.0, unique and applicable to all sorts of videos.<\/p>\n Previous supervised background subtraction algorithms relied upon having access to at least some manually-annotated frames of the same video on which they were tested, rendering them impractical. But the BU team created a \u201cplug and play\u201d algorithm that can be used on unseen videos without requiring annotations. \u201cThe novelty of our algorithm is in the inputs and augmentations,\u201d said Ishwar, \u201cWhen we apply our algorithm to a variety of background-subtraction datasets used by researchers, it generalizes well.\u201d<\/p>\n The algorithm\u2019s performance and speed lend it to a variety of applications — from surveillance and law enforcement, to robots and smart technologies. \u201cWhat was interesting is that Ozan modified the algorithm to run very fast, at video rates. There may be a use for this in real-time applications of the algorithm,\u201d said Konrad.<\/p>\n![\"\"](\"\/hic\/files\/2021\/05\/Konrad_2015_2_600x900-424x636.jpg\")
![\"\"](\"\/hic\/files\/2021\/05\/Ozan-Tezcan-photo-512x636.jpg\")
![\"\"](\"\/hic\/files\/2021\/05\/bsuvnet2-cover-photo-636x284.jpeg\")