知の物理学研究センター / Institute for Physics of Intelligence (ipi)

【Date】
Dec. 27, 2023 10:30 - 12:00 (JST)

【Speaker】
Tomoki Fukai/OIST

【Title】
“Graphical information representations in associative memory models”

【Abstract】
The associative memory model attempts to explain the brain's memory processing using attractors, and various studies have been conducted from the viewpoints of physics, engineering, psychology, biology, etc. This classic model has not long been given much attention, but it has recently been revived as its relationship with large-scale language models has been pointed out. After a brief introduction to classical and recent results of associative memory models, I will present two recent studies from my group in this seminar. First, I will show correlated-attractor associative memory models embedding graphical relationships between memory states. In the brain, memories are rarely mutually independent but usually have some hierarchical relationships. Our associative memory model stores hierarchical relationships between memory states using correlated attrator states. In terms of machine learning, our model operates similarly to the graph Laplacian for analyzing the hierarchical cluster structure of graphs. Then, the simplicial Hopfield model attempts to improve memory storage ability by mixing higher-order interactions (two-body, three-body, etc.) between neurons, such as represented by the simplicial complex. Associative memory models with many-body interactions have been studied, but their superiority in memory recall has not been demonstrated on large-scale databases such as Image Net. Finally, the relationship has been recently pointed out between spatial navigation by the hippocampus and conceptual processing and natural language processing. If time permits, I will also touch upon the results of such studies.

【Venue for on-site】
#913, #1 Faculty of Science Building

*To receive the Zoom invitation and monthly reminders, please register via this google form: https://forms.gle/dqxhpsZXLNYvbSB38

Your e-mail addresses will be used for this purpose only, you can unsubscribe anytime, and we will not send more than three e-mails per month.

Takashi Takahashi and Ken Nakanishi

⇦Top page