Welcome to NeuroAI-UW seminar, a regular weekly seminar for UW community organized by NeuroAI Shlizerman Lab.
Meetings are currently held hybridly (Summer & Fall 2020, Winter & Spring & Fall 2021-2023, Winter 2024). Contact us if you would like to join! UW students can enroll into designated courses: AMATH 500L or EE 598F to participate in the seminarial activities.
New: We will be positing some of the invited visitors talks in NeuroAI YouTube playlist.
This quarter focuses on exploring and advancing research in three interconnected domains: AI, NeuroAI, and Neuroscience. We are passionate about understanding intelligence from both artificial and biological perspectives, bridging the gap between technology and science. We host a weekly seminar where we discuss cutting-edge research from these fields. We host a weekly seminar to discuss cutting-edge research and foster collaboration.
- Time: Every Friday, 11:00 AM - 12:00 PM PDT
- Format: Presentations and discussions led by domain experts or lab members
Domain Leads
- AI: Yang Zheng
- NeuroAI: Trung Le
- Neuroscience: Jimin Kim
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 10/25/2024 | Brain-to-text Decoding with Context-aware Neural Representations and Large Language Models | Eric Martin, Jinlin Xiang, Mingfei Chen, Ted Zhong, Xiulong Liu, Yang Zheng, Yuan Gao |
| 11/01/2024 | The FlyWire connectome: neuronal wiring diagram of a complete fly brain | Trung Le, Jingyuan Li, Hao Fang, James Hazelden, Keith Phou, Bailey Hall |
| 11/08/2024 & 11/15/2024 | Tell What You Hear From What You See - Video to Audio Generation Through Text | Jimin Kim, Saba Heravi, Victoria Pierce, Weijun Liu, Jiawen Liu, Deeksha Prabhu, Dongyi Yang |
| 11/22/2024 | Guest Speaker Sven Dorkenwald (Allen Institute) |
|
| 11/29/2024 | Thanksgiving Break | |
| 12/06/2024 | Guest Speaker Xiulong Liu (UW NeuroAI) |
|
| 12/06/2024 | Guest Speaker Francis Robert Willett (Neural Prosthetics Translational Laboratory at Stanford University) |
This quarter, we review impactful alternative architectures recently proposed in the NeuroAI literature. The seminar is held every Friday from 11:00 am - noon PDT in a hybrid manner.
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 03/29/2024 | Brainstorming Meeting & Final Presentations on NeuroAI and LLMs (Team 1, 2) | Mingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng, Jinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas |
| 04/05/2024 | Organizational & Intro Meeting & Final Presentations on NeuroAI and LLMs (Team 3) | Saba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian |
| 04/12/2024 | Energy Transformer | James Hazelden, Saba Heravi, Yang Zheng |
| 04/19/2024 | State Space Models: Mamba: Linear-Time Sequence Modeling with Selective State Spaces & Efficiently Modeling Long Sequences with Structured State Spaces | Victoria Pierce, Mingfei Chen, and Xiulong Liu |
| 04/26/2024 | RNN Alternatives: RWKV: Reinventing RNNs for the Transformer Era & Hierarchically Gated Recurrent Neural Network for Sequence Modeling | Jinlin Xiang, Jesse Owens, and Jimin Kim |
| 05/03/2024 | MLP Mixer: An All MLP Architecture for Vision & The Forward-Forward Algorithm | Adithya Gowda Baragur, Seb Schwab, and Trung Le |
| 05/10/2024 | Building transformers from neurons and astrocytes & NISQ QNN: Classification with Quantum Neural Networks on Near Term Processors | Ian Quah, Sean Robert Gamer, and Jingyuan Li |
Thanks Jinlin, Mingfei and Saba for being Student Organizers.
In this quarter, we will prepare seminars on 3 critical topics related to NeuroAI and LLMs (Large Language Models). The seminar will be held every Friday 11:00am - 12:00pm (PST) hybridly.
| Topic | Student Presenter |
|---|---|
| LLM-Enhanced Neural Decoding | Mingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng |
| Domain Adaptation of Pre-trained LLM for Research | Jinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas |
| Interpretation of Neural Networks in LLMs | Saba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian |
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 1/12/2024 | Organizational & Intro Meeting on NeuroAI and LLMs | |
| 1/19/2024 | Decoding Speech Perception from Non-Invasive Brain Recordings | Mingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng |
| 1/26/2024 | Large Language Models Struggle to Learn Long-Tail Knowledge | Jinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas |
| 2/02/2024 | Hopfield Networks is All You Needs | Saba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian |
| 2/09/2024 | Guest Speaker Jean-Rémi King (École Normale Supérieure / Meta AI) |
|
| 2/16/2024 | Guest Speaker Nikhil Kandpal (University of Toronto) |
|
| 2/23/2024 | Guest Speaker: TBA |
In this quarter, we will continue to present tutorials and organize discussions on 6 critical topics related to NeuroAI.
| Topic | Student Presenter |
|---|---|
| Deep Learning Programming Tools for NeuroAI | Yang Zheng, Jazlin Taylor |
| Design, Programing and Publishing OpenSource Code for NeuroAI | Jinlin Xiang, Trung Le, Jimin Kim |
| Data and Benchmarking Practices in NeuroAI | Amisha Himanshu Somaiya, Trung Le |
| Neuro, AI and NeuroAI Ethics | Rahul Biswas, Jingyuan Li |
| Hardware Acceleration for DL and NeuroAI | Saba Heravi, James Hazelden |
| LLMs and Their Relation to NeuroAI | Mingfei Chen, Xiulong Liu, Pavan Kumar Anand |
In this quarter, we will prepare and present tutorials on 6 critical topics related to NeuroAI.
| Topic | Student Presenter |
|---|---|
| Deep Learning Programming Tools for NeuroAI | Astitwas S. Lathe, Yang Zheng, Wenxuan Hu |
| Design, Programing and Publishing OpenSource Code for NeuroAI | Jimin Kim, Jinlin Xiang, Trung Le |
| Data and Benchmarking Practices in NeuroAI | Ayush Singh, Chunqing Cao |
| Neuro, AI and NeuroAI Ethics | Rahul Biswas, Atharva Mattam, James Hazelden |
| Hardware Acceleration for DL and NeuroAI | Saba Heravi, Ruihong Yin, Carter Rowell |
| LLMs and Their Relation to NeuroAI | Xiulong Liu, Mingfei Chen, Jingyuan Li |
In this quarter, we will prepare and present tutorials on 5 critical topics related to NeuroAI.
| Topic | Student Presenter |
|---|---|
| Deep Learning Programming Tools for NeuroAI | Sadjyot Gangolli, Mingfei Chen, Xiulong Liu, Hanna Lee |
| Design, Programing and Publishing OpenSource Code for NeuroAI | Jimin Kim, Kun Su, Pranav Kamath, Jingyuan Li |
| Data and Benchmarking Practices in NeuroAI | Jinlin Xiang, Trung Le, Ayush Singh |
| Neuro, AI and NeuroAI Ethics | Rahul Biswas, Ryan Vogt, Xinwen Liu |
| Hardware Acceleration for DL and NeuroAI | Yang Zheng, James Hazelden, Saba Heravi |
Thanks Mingfei and Jingyuan for being Student Organizer.
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 10/07/2022 | Organizational & Intro Meeting on Energy Based Models | |
| 10/14/2022 | A Path Towards Autonomous Machine Intelligence | James Hazelden, Saba Heravi, Andrew Line, Yang Zheng. |
| 10/21/2022 | The surprising effectiveness of representation learning for visual imitation | Hanna Lee, Jimin Kim |
| 10/28/2022 | Self-supervised learning of pretext-invariant representations | Jinlin Xiang, Trung Le |
| Barlow twins: Self-supervised learning via redundancy reduction | Raphael Bechtold, Ryan V | |
| 11/04/2022 | Understanding the world through action | Ze Xia (Lucas) Wang, Saba Heravi |
| Deep hierarchical planning from pixels | Ruihong Yin, Pinyi Wang, Xiulong Liu | |
| 11/11/2022 | Break Veterans Day | |
| 11/18/2022 | Guest Speaker Yubei Chen (New York University) |
|
| 11/25/2022 | Break Thanksgiving | |
| 12/02/2022 | Break NeurIPS | |
| 12/09/2022 | NeurIPS Updates | |
| 12/16/2022 | Guest Speaker Kuan Fang (UC Berkeley) |
Thanks Ryan Vogt and Jingyuan Li for being the Student Organizers.
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 04/01/2022 | Organizational & Intro Meeting | |
| 04/08/2022 | VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning | Kun Su, Mingfei Chen, Harsha Vardhan |
| The Causal-Neural Connection: Expressiveness, Learnability, and Inference | Rahul Biswas, Shirui Chen, Xiulong Liu | |
| 04/15/2022 | ILQR-VAE : Control-base Learning of Input Driven Dynamics with Application To Neural Data | Pamel Kang, Trung Le, Jingyuan Li |
| Neural Active Learning with Performance Guarantees | Zhuochun Liu, Zhongshu Meng, Jinlin Xiang | |
| 04/22/2022 | Inferring Latent Dynamics Underlying Neural Population aCTIVITY VIA neural Differential Equations | Michael Nolan, Saba H, Destiny Alvarado |
| Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph | Yang Zheng, Anoop Mysore Nataraja, Malek Itani | |
| 04/29/2022 | Guest Speaker Kevin Xia (Columbia University) |
|
| 05/06/2022 | Towards Biologically Plausible Convolutional Networks | Xiangyu Gao, Yujia Liu, Xinyue Sun |
| Deep Reinforcement Learning with Spiking Q-Learning | Jingwei Xu, Miranda Anderson, Jimin Kim | |
| 05/13/2022 | A3D3 Speakers | |
| 05/20/2022 | TBA | |
| 05/27/2022 | Guest Speaker Claudio Gentile (Google) |
|
| 06/03/2022 | A3D3 Speakers | |
| 06/10/2022 | Guest Speaker Marine Schimel (Cambridge) |
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 01/14/2022 | Organizational Meeting | |
| 01/21/2022 | Where is all the nonlinearity: flexible nonlinear modeling of behaviorally relevant neural dynamics using recurrent neural networks | Michael Nolan, Saba Heravi, Ryan Vogt, Zekun Chen |
| Drop, Swap, and Generate: A Self-Supervised Approach for Generating Neural Activity | Kun Su, Xiangyu Gang, Pamel Kang, Jingyuan Li | |
| 01/28/2022 | Neural Active Learning with Performance Guarantees | Xiulong Liu, James Hazelden, Jinlin Xiang, Liem Vu |
| Dynamic Causal Modelling Revisited | Rahul Biswas, Astitwa Sarthak Lathe, Trung Le | |
| 02/04/2022 | A3D3 NeuroAI | |
| OpenLabCluster Demo | Jingyuan Li (UW ECE), Moishe Kesselman (UW CSE) | |
| Detection of Sleep Spindles with FPGA | Xiaohan Liu (UW ECE), Aidan Yokuda (UW ECE) | |
| Somatotopic representation of texture sensation in the primary somatosensory and motor cortices of mice | Megan Lipton (Purdue Neurobiology) | |
| 02/11/2022 | Guest Speaker Eva L. Dyer (Gatech) |
|
| 02/18/2022 | Stabilizing Dynamical Systems via Policy Gradient Methods | Jimin Kim, Mingfei Chen, Aidan Yokuda |
| AugMax: Adversarial Composition of Random Augmentations for Robust Training | Yang Zheng, Xiaohan Liu, Yujia Liu, Xinyue Sun | |
| 02/25/2022 | Guest Speaker Max Simchowitz (MIT) |
|
| 03/04/2022 | A3D3 NeuroAI | |
| Optimizing brain stimulation using deep learning | Seungbin Park (Purdue) | |
| Quantifying the effect of stimulation protocols on rapid network connectivity inference | Tomohiro Ouchi (UW) | |
| Modeling Neural Population Activity with Spatiotemporal Transformer | Trung Le (UW) | |
| 03/11/2022 | Guest Speaker: Omid G. Sani (USC) |
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 04/02/2021 | Deep Graph Pose: a semi-supervised deep graphical model for improved animal pose tracking | Chuanmudi Qin, Xiulong Liu, Kun Su |
| Backpropagation and the brain | Ben Francis, Felix Tse, Trung Le | |
| 04/09/2021 | Understanding self-supervised Learning Dynamics without Contrastive Pairs | Jingyuan Li, Ayesha Ghaffar, Zidan Luo |
| Closed-Form Factorization of Latent Semantics in GANs | Jingxi Yu, Xiangyu Gao, Yang Zheng | |
| 04/16/2021 | Guest Speaker: Anqi Wu (Columbia University) |
|
| 04/23/2021 | Non-reversible Gaussian processes for identifying latent dynamical structure in neural data | Rahul Biswas, Ryan Vogt, Michael Nolan |
| Modeling behaviorally relevant neural dynamics with a novel preferential subspace identification | Saba Heravi, Astitwa Lathe, Yiren Wang, Jimin Kim | |
| 04/30/2021 | Guest Speaker: Bolei Zhou (The Chinese University of Hong Kong) |
|
| 05/07/2021 | New Papers Discussion | |
| 05/14/2021 | ICLR Paper Presentation | |
| 05/21/2021 | No Meeting | |
| 05/28/2021 | Guest Speaker: Omid G. Sani (USC) |
|
| 06/04/2021 | Guest Speaker: Yuandong Tian (Facebook) |
| Date | Paper/Activity | Student Presenter |
|---|---|---|
| 10/02/2020 | Organizational Meeting | |
| 10/09/2020 | Learning a Prior over Intent via Meta-Inverse Reinforcement Learning | Yang Zheng, Rahul Biswas |
| Universality and Individuality in recurrent networks | Michael Nolan, Ben Francis | |
| 10/16/2020 | Unsupervised deep learning identifies semantic disentanglement in single inferotemporal neurons | Jinlin Xiang, Ryan Vogt |
| Low-dimensional dynamics for working memory and time encoding | Jimin Kim, Trung Le, David Babin | |
| 10/23/2020 | Guest Speaker: Niru Maheswaranathan |
|
| 10/30/2020 | Rotational Dynamics Reduce Interference Between Sensory and Memory Represenatations | Jingyuan Li, Saba Heravi |
| Foley Music: Learning to Generate Music from Videos | Kun Su, Xiulong Liu | |
| 11/06/2020 | Guest Speaker: Christopher Cueva |
|
| 11/13/2020 | No meeting | |
| 11/20/2020 | Guest Speaker: Alexandra Libby | |
| 11/27/2020 | Thanksgiving Break - No meeting | |
| 12/4/2020 | Guest Speaker: Irina Higgins |
|
| 12/4/2020 | Guest Speaker: Chuang Gan |
|
| 12/11/2020 | Research Video Updates |
We are reading papers published in recent Top AI Conferences (CVPR 2020, ICML 2020)!