{"id":114810,"date":"2022-02-11T09:46:40","date_gmt":"2022-02-11T13:46:40","guid":{"rendered":"http:\/\/www.bu.edu\/eng\/?p=114810"},"modified":"2024-02-29T15:09:34","modified_gmt":"2024-02-29T20:09:34","slug":"the-powers-of-machine-learning-in-amazon-alexa-and-music-generation","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/eng\/2022\/02\/11\/the-powers-of-machine-learning-in-amazon-alexa-and-music-generation\/","title":{"rendered":"The Powers of Machine Learning in Amazon Alexa and Music Generation"},"content":{"rendered":"
\"\"
Associate Professor\u00a0(ECE, CS, CDS, SE) Brian Kulis<\/figcaption><\/figure>\n

Every day millions of people look something up online. It\u2019s become a habit, a part of our lives that we take for granted\u2013 and we can thank machine learning for that. Machine learning is a type of artificial intelligence that works with computer algorithms. It uses data and statistics to create predictions and it tries to imitate the way humans learn.<\/p>\n

CISE Faculty Affiliate Brian Kulis works in the area of machine learning. Kulis is Associate Professor\u00a0<\/span>(ECE, CS, CDS, SE) at Boston University and is also an Amazon Alexa Scholar.<\/span>\u00a0While originally focused on unsupervised machine learning,\u00a0<\/span>Kulis\u2019 recent research focuses on various core machine learning problems, as well as applied machine learning such as for\u00a0<\/span>music generation and Amazon Alexa applications.<\/span><\/p>\n

In applying machine learning to data-related applications, Kulis typically starts by designing an algorithm and then tweaking that algorithm to apply to different applications. However, Kulis says that it is also possible to start with the application and from there, build the algorithm. This is what some of his students have done in his build lab. Years ago, Rachel Manzelli and\u00a0<\/span>Vijay Thakkar<\/span>, undergraduate students, took on the project of generating music. From there, Master\u2019s students,\u00a0<\/span>Yousif Khaireddin<\/span>\u00a0and\u00a0<\/span>Krishna Palle,<\/span>\u00a0and Ph.D. student Sadie Allen have also worked on the project.\u00a0<\/span><\/p>\n

Kulis said they\u2019ve been attacking the problem from an applications (techniques to building models) and a theoretical perspective (algorithms behind models).\u00a0<\/span><\/p>\n

Kulis\u2019 work with generating music attempted to combine a model generating raw audio and a model generating notes. Generating raw audio can be more difficult since it\u2019s not reproducing notes, but it has its advantages because it can produce different sounds. By combining the two models, he and his team were able to construct a symbolic version of a song and then add the component of raw audio to produce music that sounds more natural.\u00a0<\/span><\/p>\n

Kulis said he trained the models on music which enabled them to start generating music.\u00a0<\/span><\/p>\n

\u201cYou give it training data, and in this case training data for the raw audio models, which are recordings of music,\u201d Kulis said. \u201cThen what the model is trying to do is it\u2019s going to build a model that says, \u2018Okay, if I\u2019ve listened to a second of audio say, from this from a track, I\u2019m going to try to predict how the next little piece of audio looks.\u2019\u201d\u00a0<\/span><\/p>\n

Generating music automatically is beneficial for apps like Spotify, which might not want to spend a lot of money on hiring people to create background music. It\u2019s also meant to help artists make music.<\/span><\/p>\n

\u201cWe actually aren\u2019t just interested in taking artists out of the loop,\u201d Kulis said. \u201cWe want to help artists in the creative process as well. So there\u2019s some examples of musicians using AI tools to help them generate melodies.\u201d<\/span><\/p>\n

Kulis is also active in industry research. As an Amazon Scholar, he is working to improve the accuracy of when Alexa responds to its name. This is triggered by the wakeword, which is \u201cAlexa\u201d.\u00a0<\/span><\/p>\n

In order to eliminate false wakes, which can occur when the device thinks its name is being said, the device has a classifier on the hardware that is constantly trying to determine whether or not Alexa should be responding. Alexa responds when it is confirmed in the Cloud that the person said the word \u201cAlexa\u201d. Essentially, the audio gets translated into a spectrogram, which allows the sound to be captured visually. If the spectrogram matches the spectrogram of the sound produced when Alexa is spoken, then the device responds.\u00a0<\/span><\/p>\n

Once the device recognizes that it has been woken up, it will record what\u2019s being said so it can send information to the Cloud, which might be thousands of miles away. This all happens seamlessly in milliseconds. Kulis and his team have worked on eliminating false wakes by setting up a secondary network in the Cloud that verifies the wakeword. Kulis shares findings about this work in a paper titled\u00a0<\/span>Building a Robust Word-Level Verification Network<\/span><\/a>.<\/span><\/p>\n

As Associate Professor at Boston University, Kulis has created two courses, \u201cIntro to Machine Learning\u201d available to undergraduates, and \u201cDeep Learning\u201d, taught at the graduate level. He said many students have gone into industry after taking these courses and that\u2019s how he hopes to influence others through his work with machine learning.\u00a0<\/span><\/p>\n

Kulis wrote in an email that machine learning has benefited society in terms of improving patient outcomes by\u00a0<\/span>automating data analysis and driving research progress forward more quickly. He also said it has impacted daily lives.\u00a0\u00a0<\/span><\/p>\n

\u201cEvery time we use Google or do any kind of online search, we are using machine learning,\u201d Kulis said. \u201cMachine learning for audio has changed how we interact with computers, and self-driving cars, someday, will routinely save thousands or millions of lives.\u201d\u00a0<\/span><\/p>\n

By Zoe Tseng, CISE Staff Writer<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Every day millions of people look something up online. It\u2019s become a habit, a part of our lives that we take for granted\u2013 and we can thank machine learning for that. Machine learning is a type of artificial intelligence that works with computer algorithms. It uses data and statistics to create predictions and it tries […]<\/p>\n","protected":false},"author":20115,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[236,1152,287,318,977,240,907],"tags":[260,264],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/114810"}],"collection":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/users\/20115"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/comments?post=114810"}],"version-history":[{"count":1,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/114810\/revisions"}],"predecessor-version":[{"id":128523,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/posts\/114810\/revisions\/128523"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/media?parent=114810"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/categories?post=114810"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/eng\/wp-json\/wp\/v2\/tags?post=114810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}