Skip to content

Commit

Permalink
Put section number
Browse files Browse the repository at this point in the history
When viewed from an IDE with navigation (e.g. DataSpell) it looked like
```
4. Equation 1: ...
Equation 2: ...
6. Equation 3: ...
```
so I simply added "5." to make it clearer "5. Equation 2: Multihead Self-Attention (MSA block)" is the 5th section
  • Loading branch information
ideaguy3d authored Jan 29, 2024
1 parent 0fa794b commit 905290d
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions video_notebooks/08_pytorch_paper_replicating_video.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -2500,7 +2500,7 @@
{
"cell_type": "markdown",
"source": [
"## Equation 2: Multihead Self-Attention (MSA block)\n",
"## 5. Equation 2: Multihead Self-Attention (MSA block)\n",
"\n",
"* **Multihead self-attention** = which part of a sequence should pay the most attention to itself?\n",
" * In our case, we have a series of embedded image patches, which patch significantly relates to another patch.\n",
Expand Down Expand Up @@ -4051,4 +4051,4 @@
"outputs": []
}
]
}
}

0 comments on commit 905290d

Please sign in to comment.