Merge pull request #817 from ideaguy3d/patch-1

Put section number for Section 5 "Equation 2: Multihead Self-Attention (MSA block)"
mrdbourke · Aug 22, 2024 · e32e544 · e32e544
2 parents 9f1084e + 905290d
commit e32e544
Showing 1 changed file with 2 additions and 2 deletions.
diff --git a/video_notebooks/08_pytorch_paper_replicating_video.ipynb b/video_notebooks/08_pytorch_paper_replicating_video.ipynb
@@ -2500,7 +2500,7 @@
     {
       "cell_type": "markdown",
       "source": [
-        "## Equation 2: Multihead Self-Attention (MSA block)\n",
+        "## 5. Equation 2: Multihead Self-Attention (MSA block)\n",
         "\n",
         "* **Multihead self-attention** = which part of a sequence should pay the most attention to itself?\n",
         "  * In our case, we have a series of embedded image patches, which patch significantly relates to another patch.\n",
@@ -4051,4 +4051,4 @@
       "outputs": []
     }
   ]
-}
+}