{"id":15474,"date":"2019-01-28T14:33:26","date_gmt":"2019-01-28T19:33:26","guid":{"rendered":"https:\/\/www.bu.edu\/hic\/?p=15474"},"modified":"2019-02-26T13:37:36","modified_gmt":"2019-02-26T18:37:36","slug":"some-empirical-observations-linking-representation-and-generalization","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/hic\/2019\/01\/28\/some-empirical-observations-linking-representation-and-generalization\/","title":{"rendered":"Some Empirical Observations Linking Representation and Generalization"},"content":{"rendered":"<figure id=\"attachment15476\" aria-describedby=\"caption-attachment15476\" style=\"width: 710px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" src=\"\/hic\/files\/2019\/01\/deep-learning-1024x565.jpg\" alt=\"circuitry as brain illustration\" width=\"700\" height=\"386\" class=\"wp-image-15476\" srcset=\"https:\/\/www.bu.edu\/hic\/files\/2019\/01\/deep-learning-1024x565.jpg 1024w, https:\/\/www.bu.edu\/hic\/files\/2019\/01\/deep-learning-636x351.jpg 636w, https:\/\/www.bu.edu\/hic\/files\/2019\/01\/deep-learning-768x424.jpg 768w, https:\/\/www.bu.edu\/hic\/files\/2019\/01\/deep-learning.jpg 1344w\" sizes=\"(max-width: 700px) 100vw, 700px\" \/><figcaption id=\"caption-attachment15476\" class=\"wp-caption-text\">Deep Learning<\/figcaption><\/figure>\n<h3 class=\"p1\"><span class=\"s1\">Samy Bengio, Google<\/span><\/h3>\n<p><strong>When:<br \/>\n<\/strong><span class=\"s1\">Monday, February 4, 2019<br \/>\n<\/span>Networking reception, 10:30-11:00am; Seminar 11:00-12:00pm<br \/>\n<strong>Where:<br \/>\n<\/strong><span class=\"s1\">Photonics Building: 8 St. Mary\u2019s Street, 9th Floor, Colloquium Room<\/span><\/p>\n<figure id=\"attachment15481\" aria-describedby=\"caption-attachment15481\" style=\"width: 235px\" class=\"wp-caption alignright\"><img loading=\"lazy\" src=\"\/hic\/files\/2019\/01\/samy-bengio.jpeg\" alt=\"samy bengio\" width=\"225\" height=\"225\" class=\"wp-image-15481\" srcset=\"https:\/\/www.bu.edu\/hic\/files\/2019\/01\/samy-bengio.jpeg 365w, https:\/\/www.bu.edu\/hic\/files\/2019\/01\/samy-bengio-150x150.jpeg 150w, https:\/\/www.bu.edu\/hic\/files\/2019\/01\/samy-bengio-189x189.jpeg 189w, https:\/\/www.bu.edu\/hic\/files\/2019\/01\/samy-bengio-100x100.jpeg 100w\" sizes=\"(max-width: 225px) 100vw, 225px\" \/><figcaption id=\"caption-attachment15481\" class=\"wp-caption-text\">Samy Bengio<\/figcaption><\/figure>\n<p class=\"p1\"><span class=\"s1\"><strong>Abstract:<\/strong> Deep learning has shown incredible successes in the past few years, but there is still a lot of work remaining in order to understand some of these successes. Why do such over-parameterized models still generalize so well? In this presentation, I will cover a few of my recent work empirically showing interesting relations between learned internal representations and generalization. Note that this covers joint work with many of my colleagues at Google Brain. <\/span><\/p>\n<hr \/>\n<p class=\"p1\"><span class=\"s1\"><strong>Bio:<\/strong> Samy Bengio (PhD in computer science, University of Montreal, 1993) is a research scientist at Google since 2007. He currently leads a group of research scientists in the Google Brain team, conducting research in many areas of machine learning such as deep architectures, representation learning, sequence processing, speech recognition, image understanding, large-scale problems, adversarial settings, etc. He is the general chair for Neural Information Processing Systems (NeurIPS) 2018, the main conference venue for machine learning, was the program chair for NIPS in 2017, is action editor of the Journal of Machine Learning Research and on the editorial board of the Machine Learning Journal, was program chair of the International Conference on Learning Representations (ICLR 2015, 2016), general chair of BayLearn (2012-2015) and the Workshops on Machine Learning for Multimodal Interactions (MLMI&#8217;2004-2006), as well as the IEEE Workshop on Neural Networks for Signal Processing (NNSP&#8217;2002), and on the program committee of several international conferences such as NIPS, ICML, ICLR, ECML and IJCAI. More information can be found on his website.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Samy Bengio, Google When: Monday, February 4, 2019 Networking reception, 10:30-11:00am; Seminar 11:00-12:00pm Where: Photonics Building: 8 St. Mary\u2019s Street, 9th Floor, Colloquium Room Abstract: Deep learning has shown incredible successes in the past few years, but there is still a lot of work remaining in order to understand some of these successes. Why do [&hellip;]<\/p>\n","protected":false},"author":8550,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[11771,11748],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/15474"}],"collection":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/users\/8550"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/comments?post=15474"}],"version-history":[{"count":10,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/15474\/revisions"}],"predecessor-version":[{"id":15494,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/posts\/15474\/revisions\/15494"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/media?parent=15474"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/categories?post=15474"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/hic\/wp-json\/wp\/v2\/tags?post=15474"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}