This code accompanies the paper: David Chiang and Peter Cholak, Overcoming a theoretical limitation of self-attention, to appear in Proc. ACL, 2022.
Tested with Python 3.9.6 and PyTorch 1.9.1.
This code is in the public domain.
-
Notifications
You must be signed in to change notification settings - Fork 3
ndnlp/parity
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Code for "Overcoming a Theoretical Limitation of Self-Attention"