{"id":35746,"date":"2022-02-01T15:18:42","date_gmt":"2022-02-01T20:18:42","guid":{"rendered":"https:\/\/www.bu.edu\/cise\/?p=35746"},"modified":"2022-02-24T19:11:58","modified_gmt":"2022-02-25T00:11:58","slug":"cise-faculty-affiliate-spotlight-brian-kulis","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/cise\/cise-faculty-affiliate-spotlight-brian-kulis\/","title":{"rendered":"CISE Faculty Spotlight: Brian Kulis"},"content":{"rendered":"<h1><img loading=\"lazy\" src=\"\/cise\/files\/2022\/02\/kulis-zoe.png\" alt=\"\" width=\"600\" height=\"400\" class=\"wp-image-35882 size-full aligncenter\" \/><\/h1>\n<h1>The powers of machine learning in Amazon Alexa and music generation<\/h1>\n<p><span style=\"font-weight: 400;\">Every day millions of people look something up online. It\u2019s become a habit, a part of our lives that we take for granted\u2013 and we can thank machine learning for that. Machine learning is a type of artificial intelligence that works with computer algorithms. It uses data and statistics to create predictions and it tries to imitate the way humans learn.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">CISE Faculty Affiliate <strong>Brian Kulis<\/strong> works in the area of machine learning. Kulis is Associate Professor <\/span><span style=\"font-weight: 400;\">(ECE, CS, CDS, SE) at Boston University and is also an Amazon Alexa Scholar.<\/span><span style=\"font-weight: 400;\"> While originally focused on unsupervised machine learning, <\/span><span style=\"font-weight: 400;\">Kulis&#8217; recent research focuses on various core machine learning problems, as well as applied machine learning such as for <\/span><span style=\"font-weight: 400;\">music generation and Amazon Alexa applications.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In applying machine learning to data-related applications, Kulis typically starts by designing an algorithm and then tweaking that algorithm to apply to different applications. However, Kulis says that it is also possible to start with the application and from there, build the algorithm. This is what some of his students have done in his build lab. Years ago, Rachel Manzelli and <\/span><span style=\"font-weight: 400;\">Vijay Thakkar<\/span><span style=\"font-weight: 400;\">, undergraduate students, took on the project of generating music. From there, Master\u2019s students, <\/span><span style=\"font-weight: 400;\">Yousif Khaireddin<\/span><span style=\"font-weight: 400;\"> and <\/span><span style=\"font-weight: 400;\">Krishna Palle,<\/span><span style=\"font-weight: 400;\"> and Ph.D. student Sadie Allen have also worked on the project.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Kulis said they\u2019ve been attacking the problem from an applications (techniques to building models) and a theoretical perspective (algorithms behind models).\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Kulis\u2019 work with generating music attempted to combine a model generating raw audio and a model generating notes. Generating raw audio can be more difficult since it\u2019s not reproducing notes, but it has its advantages because it can produce different sounds. By combining the two models, he and his team were able to construct a symbolic version of a song and then add the component of raw audio to produce music that sounds more natural.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Kulis said he trained the models on music which enabled them to start generating music.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cYou give it training data, and in this case training data for the raw audio models, which are recordings of music,\u201d Kulis said. \u201cThen what the model is trying to do is it&#8217;s going to build a model that says, \u2018Okay, if I&#8217;ve listened to a second of audio say, from this from a track, I&#8217;m going to try to predict how the next little piece of audio looks.\u2019\u201d\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Generating music automatically is beneficial for apps like Spotify, which might not want to spend a lot of money on hiring people to create background music. It\u2019s also meant to help artists make music.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cWe actually aren&#8217;t just interested in taking artists out of the loop,\u201d Kulis said. \u201cWe want to help artists in the creative process as well. So there&#8217;s some examples of musicians using AI tools to help them generate melodies.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Kulis is also active in industry research. As an Amazon Scholar, he is working to improve the accuracy of when Alexa responds to its name. This is triggered by the wakeword, which is \u201cAlexa\u201d.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In order to eliminate false wakes, which can occur when the device thinks its name is being said, the device has a classifier on the hardware that is constantly trying to determine whether or not Alexa should be responding. Alexa responds when it is confirmed in the Cloud that the person said the word \u201cAlexa\u201d. Essentially, the audio gets translated into a spectrogram, which allows the sound to be captured visually. If the spectrogram matches the spectrogram of the sound produced when Alexa is spoken, then the device responds.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Once the device recognizes that it has been woken up, it will record what\u2019s being said so it can send information to the Cloud, which might be thousands of miles away. This all happens seamlessly in milliseconds. Kulis and his team have worked on eliminating false wakes by setting up a secondary network in the Cloud that verifies the wakeword. Kulis shares findings about this work in a paper titled <\/span><a href=\"https:\/\/assets.amazon.science\/ba\/c5\/bd48ce11445ba0368d2d9191600d\/building-a-robust-word-level-wakeword-verification-network.pdf\"><span style=\"font-weight: 400;\">Building a Robust Word-Level Verification Network<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As Associate Professor at Boston University, Kulis has created two courses, \u201cIntro to Machine Learning\u201d available to undergraduates, and \u201cDeep Learning\u201d, taught at the graduate level. He said many students have gone into industry after taking these courses and that\u2019s how he hopes to influence others through his work with machine learning.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Kulis wrote in an email that machine learning has benefited society in terms of improving patient outcomes by <\/span><span style=\"font-weight: 400;\">automating data analysis and driving research progress forward more quickly. He also said it has impacted daily lives.\u00a0\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cEvery time we use Google or do any kind of online search, we are using machine learning,\u201d Kulis said. \u201cMachine learning for audio has changed how we interact with computers, and self-driving cars, someday, will routinely save thousands or millions of lives.\u201d\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The powers of machine learning in Amazon Alexa and music generation Every day millions of people look something up online. It\u2019s become a habit, a part of our lives that we take for granted\u2013 and we can thank machine learning for that. Machine learning is a type of artificial intelligence that works with computer algorithms. [&hellip;]<\/p>\n","protected":false},"author":19737,"featured_media":35882,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[204],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/35746"}],"collection":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/users\/19737"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/comments?post=35746"}],"version-history":[{"count":11,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/35746\/revisions"}],"predecessor-version":[{"id":36016,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/posts\/35746\/revisions\/36016"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/media\/35882"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/media?parent=35746"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/categories?post=35746"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/cise\/wp-json\/wp\/v2\/tags?post=35746"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}