{"id":3466,"date":"2021-11-22T15:46:07","date_gmt":"2021-11-22T06:46:07","guid":{"rendered":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/?p=3466"},"modified":"2021-12-20T11:47:54","modified_gmt":"2021-12-20T02:47:54","slug":"ipi-seminar-1030-1200-thursday-dec-16-2021","status":"publish","type":"post","link":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/%e5%9b%ba%e5%ae%9a%e3%83%9a%e3%83%bc%e3%82%b8\/3466\/","title":{"rendered":"[finished] ipi seminar 10:30-12:00, Thursday Dec. 16, 2021"},"content":{"rendered":"\n<h3>\u77e5\u306e\u7269\u7406\u5b66\u7814\u7a76\u30bb\u30f3\u30bf\u30fc \/ Institute for Physics of Intelligence (ipi)<\/h3>\n<p>&nbsp;<\/p>\n<p>\u3010Speaker\u3011Sho YAIDA&nbsp; (Meta AI)<\/p>\n<p>\u3010Date\u301110:30-12:00 JST, Thursday, Dec. 16<\/p>\n<p>\u3010Title\u3011\"Effective Theory of Deep Neural Networks\"<br data-rich-text-line-break=\"true\"><br data-rich-text-line-break=\"true\">\u3010Abstract\u3011<br>Large neural networks perform extremely well in practice, providing the backbone of modern machine learning. The goal of this talk is to provide a blueprint for theoretically analyzing these large models from first principles. In particular, we'll overview how the statistics and dynamics of deep neural networks drastically simplify at large width and become analytically tractable. In so doing, we'll see that the idealized infinite-width limit is too simple to capture several important aspects of deep learning such as representation learning. To address them, we'll step beyond the idealized limit and systematically incorporate finite-width corrections.<\/p>\n<div><span class=\"x_author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z8z86zdnagz83zz74zikpz70zz72zkz79zkfbz71z2z88zz74zm9gxc1z74zz79zk\">*To receive the Zoom invitation and monthly reminders,<span class=\"x_Apple-converted-space\">&nbsp;<\/span><\/span><span class=\"x_author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z8z86zdnagz83zz74zikpz70zz72zkz79zkfbz71z2z88zz74zm9gxc1z74zz79zk\"><b>please register via this google form<\/b><\/span><span class=\"x_author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z8z86zdnagz83zz74zikpz70zz72zkz79zkfbz71z2z88zz74zm9gxc1z74zz79zk\">:<span class=\"x_Apple-converted-space\">&nbsp;<\/span><\/span><span class=\"x_attrlink x_url x_author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z8z86zdnagz83zz74zikpz70zz72zkz79zkfbz71z2z88zz74zm9gxc1z74zz79zk x_url\"><a class=\"x_attrlink\" href=\"https:\/\/forms.gle\/dqxhpsZXLNYvbSB38\" target=\"_blank\" rel=\"noreferrer nofollow noopener\" data-auth=\"NotApplicable\"><u>https:\/\/forms.gle\/dqxhpsZXLNYvbSB38<\/u><\/a><\/span><\/div>\n<div><span class=\"x_author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z8z86zdnagz83zz74zikpz70zz72zkz79zkfbz71z2z88zz74zm9gxc1z74zz79zk\">Your e-mail addresses will be used for this purpose only, you can unsubscribe anytime, and we will not send more than three e-mails per month.<\/span><\/div>\n<div>&nbsp;<\/div>\n<div><a href=\"https:\/\/www.phys.s.u-tokyo.ac.jp\/wp-content\/uploads\/2021\/12\/PDLT_IPI2021.pdf\">PDF<\/a><\/div>\n<div>&nbsp;<\/div>\n<div style=\"text-align: right\">Tilman HARTWIG, Takashi TAKAHASHI &amp; Ken NAKANISHI<\/div>\n<div>&nbsp;<\/div>\n<div><a href=\"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/lp\/ipi\/\">\u21e6Top page<\/a><\/div>\n","protected":false},"excerpt":{"rendered":"\u77e5\u306e\u7269\u7406\u5b66\u7814\u7a76\u30bb\u30f3\u30bf\u30fc \/ Institute for Physics of Intelligence (ipi) &nbsp; \u3010Speaker\u3011Sho YAIDA&nbsp; (Meta AI) \u3010Date\u301110:3 [&hellip;]","protected":false},"author":13,"featured_media":3278,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"_links":{"self":[{"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/posts\/3466"}],"collection":[{"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/comments?post=3466"}],"version-history":[{"count":7,"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/posts\/3466\/revisions"}],"predecessor-version":[{"id":3542,"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/posts\/3466\/revisions\/3542"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/media\/3278"}],"wp:attachment":[{"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/media?parent=3466"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/categories?post=3466"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.phys.s.u-tokyo.ac.jp\/en\/wp-json\/wp\/v2\/tags?post=3466"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}