{"id":47869,"date":"2020-05-19T08:50:43","date_gmt":"2020-05-19T12:50:43","guid":{"rendered":"http:\/\/www.bu.edu\/cas\/?p=47869"},"modified":"2020-05-22T08:58:15","modified_gmt":"2020-05-22T12:58:15","slug":"at-the-forefront-of-machine-learning","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/cas\/at-the-forefront-of-machine-learning\/","title":{"rendered":"At the Forefront of Machine Learning"},"content":{"rendered":"

By Jeremy Schwab<\/span><\/p>\n

In an analog world, translating from one language to another was often done with the help of a dictionary. In today\u2019s digital world, with access to incredibly fast computer algorithms and a vast amount of data, researchers are building a new landscape for language translation. And because computers are the ones doing the translating in this new reality, the landscape is one that a machine can understand. Derry Wijaya, a computer scientist at CAS and a pioneer in this new space, explains.<\/span><\/p>\n

\"\"
Derry Wijaya<\/figcaption><\/figure>\n

\u201cThe current natural-language processing approach is to treat words not like characters but rather like a vector,\u201d she says. \u201cSo you can embed that word in a vector space. It\u2019s a high-dimensional space, and each point in that space is a word.\u201d<\/span><\/p>\n

The idea is that words that are similar will live nearby each other in that space. So \u201ckitten\u201d or \u201cfurry\u201d are close together with \u201ccat.\u201d Computer scientists like Wijaya can then map two languages onto each other, creating a rough translation. This rough translation is then refined by feeding the computer program a diet of correct sentences in each language. The program then learns how to better translate between the two vector spaces (learning where the languages differ from each other).<\/span><\/p>\n

All of this is done using a technique called deep learning, which is a method of machine learning that empowers computer programs to learn through trial and error and begin to solve problems for themselves without a human having to feed them exact instructions.<\/span><\/p>\n

Getting from 100 to 7,000<\/h4>\n

Of the roughly 7,000 human languages, Google Translate, which is increasingly used to communicate between languages, can translate only about 100. Wijaya envisions a day when anybody with a smartphone or computer can quickly translate between their language and another. To help bring that day a little bit closer, she developed a tool using natural-language processing that can translate from a so-called \u201cunder-resourced\u201d language to another language. Under-resourced languages are rich in cultural meaning and tradition but do not have a wide presence on the web and so are harder to translate using a more traditional technique like comparing parallel or like sentences.<\/span><\/p>\n

\u201cThere is this big gap between what\u2019s available and what could be available,\u201d says Wijaya, a CAS assistant professor of computer science.<\/span><\/p>\n

Since Wijaya published her findings, others in the field have built off of the techniques she helped pioneer. Eventually, she hopes that this approach can help big social media platforms better police hate speech in under-resourced languages by detecting and taking down posts before they incite violence. She also foresees other uses, like allowing immigrants to communicate better with people in their new countries, or helping social media users communicate more easily across languages (for instance to send disaster aid).\u00a0<\/span><\/p>\n

A faster way<\/h4>\n

Since Wijaya began working in natural-language processing, the field has grown dramatically as more and more researchers take advantage of deep learning tools. And in this growing pack, Wijaya\u2019s research still stands out. For instance, the prestigious Association for Computational Linguistics conference recently accepted a paper she submitted. The conference, which will be virtual this year due to the pandemic, has a very low acceptance rate for papers, with over 4,000 applications this year (twice the amount as last year).\u00a0<\/span><\/p>\n

Wijaya\u2019s paper describes a shortcut of sorts that she has discovered for doing data analysis between two languages. She and colleague Lei Guo from the BU College of Communication had been collaborating on an analysis of the news treatment of topics like gun violence or global warming across languages and countries. And what Wijaya found was that if you are looking to analyze the use of very specific terms like \u201cgun control\u201d or \u201cgun rights\u201d and also the general tone of the news article those terms are used in, you can do it without teaching a computer how to translate entire languages.<\/span><\/p>\n

How does it work? Wijaya and Guo first create a \u201cframe,\u201d or way of analyzing news articles, in English. They do this by teaching a computer program to categorize articles based on their tone and point of view. Then Wijaya has that program interface with programs that are trained separately in German and Turkish using her vector-space approach. She then teaches the programs the correct translations in each language of just certain key words like \u201cgun control\u201d or \u201cgun rights\u201d or other hot-button terms that are directly relevant to her research focus and often convey the point of view of the author.\u00a0<\/span><\/p>\n

\u201cThese key words act as anchors that let you code-switch,\u201d she explains, using a term for switching rapidly from one language to another. \u201cSo the vectors become more similar across languages.\u201d\u00a0<\/span><\/p>\n

Wijaya found that the program was then able to analyze the point of view of the article just as accurately as it would have using full-language translation software like Google Translate. The accuracy she achieved is possible in part because Google Translate introduces some errors that Wijaya avoided and that were critical to her research focus, such as when Google Translate translated \u201cgun control\u201d in English to \u201cgun rights\u201d in German\u2014effectively the opposite meaning.<\/span><\/p>\n

For the purpose of this type of narrow research (as opposed to translating whole languages), it doesn\u2019t matter that her program doesn\u2019t fully understand or translate every word in an article. \u201cIt\u2019s the same way humans first start to learn language,\u201d she says. \u201cMaybe we don\u2019t know the whole sentence but we learn the important bits of it in order to start to understand it.\u201d<\/span><\/p>\n

In the same vein, Wijaya sees the broader field of machine learning and deep learning as in its infancy, still trying to understand the basics and build off of that. She imagines a future where machines begin to use both perception and reasoning to analyze information.<\/span><\/p>\n

\u201cI think with the neural network, we have a way of allowing the machine to perceive the world in a way we have never been able to before, for instance perceiving images or videos without needing to write rules about it to help them understand it,\u201d she says. \u201cThey can produce good representations of the world, such as sentences as vectors. But I think there is still a long way to go in terms of having human intelligence in machines, because these things are just perception.\u201d<\/span><\/p>\n

\u201cThere is more to intelligence than perceiving things,\u201d she continues. \u201cLike reasoning. And doing reasoning with vectors is not easy. For instance, to use logic like \u2018If x then y,\u2019 if x and y are both vectors then you can\u2019t do reasoning very easily with that. So I think the way it\u2019s moving is towards using neural networks as our senses. Then doing more internal representation, which is more symbolic. So this combination of distributional representation and symbolic representation would be where it\u2019s going.\u201d<\/span><\/p>\n

Diversifying computer science<\/h4>\n

Wijaya also makes it her mission to expand access to and awareness of opportunities in computer science to young women. Along with fellow CAS computer scientist Kate Saenko, she is organizing a workshop for undergraduate women in computer science-related fields to learn more about research opportunities in computer science. Postponed until the fall due to the coronavirus, the workshop already has 50 applicants from universities around the Boston area. Participants will learn about opportunities to build research experience (with the focus of this year’s being artificial intelligence) while still undergraduates and be encouraged to apply to graduate programs\u2014a level of computer science training where there are not as many women.<\/p>\n

The program is called Explore CS Research Iniative, and Google Research gave funding to 24 universities this year to participate. The initiative is based on one at Carnegie Mellon University, which Wijaya helped organize when she was a PhD student there.<\/p>\n

“I feel it is important to increase the involvement of women in CS research and research careers for many reasons,” says Wijaya. “Women are still currently underrepresented in these areas. Since 2000, women have earned only one in five computer science doctoral degrees. I truly believe that by diversifying the field, we can discover better and more interesting problems and ideas to solve in research as this diversity can bring fresh perspectives that are often much needed in research.”<\/span><\/p>\n

More Stories<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Computer scientist Derry Wijaya builds tools to translate “low-resource” languages and track how media perspectives shape public opinion.<\/p>\n","protected":false},"author":3521,"featured_media":47871,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[195],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/posts\/47869"}],"collection":[{"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/users\/3521"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/comments?post=47869"}],"version-history":[{"count":5,"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/posts\/47869\/revisions"}],"predecessor-version":[{"id":48037,"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/posts\/47869\/revisions\/48037"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/media\/47871"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/media?parent=47869"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/categories?post=47869"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/cas\/wp-json\/wp\/v2\/tags?post=47869"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}