Skip to content

Commit

Permalink
Rebuild
Browse files Browse the repository at this point in the history
  • Loading branch information
9bow committed Mar 2, 2024
1 parent f73fdb8 commit dfc7f1e
Show file tree
Hide file tree
Showing 437 changed files with 251,135 additions and 249,268 deletions.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.16"
"version": "3.10.11"
}
},
"nbformat": 4,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"\ud30c\uc77c\uc740 \ubaa8\ub450 \uc720\ub2c8 \ucf54\ub4dc\ub85c \ub418\uc5b4\uc788\uc5b4 \uac04\ub2e8\ud558\uac8c\ud558\uae30 \uc704\ud574 \uc720\ub2c8 \ucf54\ub4dc \ubb38\uc790\ub97c\nASCII\ub85c \ubcc0\ud658\ud558\uace0, \ubaa8\ub4e0 \ubb38\uc790\ub97c \uc18c\ubb38\uc790\ub85c \ub9cc\ub4e4\uace0, \ub300\ubd80\ubd84\uc758 \uad6c\ub450\uc810\uc744\n\uc9c0\uc6cc\uc90d\ub2c8\ub2e4.\n\n\n"
"\ud30c\uc77c\uc740 \ubaa8\ub450 \uc720\ub2c8 \ucf54\ub4dc\ub85c \ub418\uc5b4\uc788\uc5b4 \uac04\ub2e8\ud558\uac8c \ud558\uae30 \uc704\ud574 \uc720\ub2c8 \ucf54\ub4dc \ubb38\uc790\ub97c\nASCII\ub85c \ubcc0\ud658\ud558\uace0, \ubaa8\ub4e0 \ubb38\uc790\ub97c \uc18c\ubb38\uc790\ub85c \ub9cc\ub4e4\uace0, \ub300\ubd80\ubd84\uc758 \uad6c\ub450\uc810\uc744\n\uc9c0\uc6cc\uc90d\ub2c8\ub2e4.\n\n\n"
]
},
{
Expand Down Expand Up @@ -230,7 +230,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"### \ubaa8\ub378 \ud559\uc2b5\n\n\ud559\uc2b5\uc744 \uc704\ud574\uc11c \uc778\ucf54\ub354\uc5d0 \uc785\ub825 \ubb38\uc7a5\uc744 \ub123\uace0 \ubaa8\ub4e0 \ucd9c\ub825\uacfc \ucd5c\uc2e0 \uc740\ub2c9 \uc0c1\ud0dc\ub97c\n\ucd94\uc801\ud569\ub2c8\ub2e4. \uadf8\ub7f0 \ub2e4\uc74c \ub514\ucf54\ub354\uc5d0 \uccab \ubc88\uc9f8 \uc785\ub825\uc73c\ub85c ``<SOS>`` \ud1a0\ud070\uacfc\n\uc778\ucf54\ub354\uc758 \ub9c8\uc9c0\ub9c9 \uc740\ub2c9 \uc0c1\ud0dc\uac00 \uccab\ubc88\uca68 \uc740\ub2c9 \uc0c1\ud0dc\ub85c \uc81c\uacf5\ub429\ub2c8\ub2e4.\n\n\"Teacher forcing\"\uc740 \ub2e4\uc74c \uc785\ub825\uc73c\ub85c \ub514\ucf54\ub354\uc758 \uc608\uce21\uc744 \uc0ac\uc6a9\ud558\ub294 \ub300\uc2e0\n\uc2e4\uc81c \ubaa9\ud45c \ucd9c\ub825\uc744 \ub2e4\uc74c \uc785\ub825\uc73c\ub85c \uc0ac\uc6a9\ud558\ub294 \ucee8\uc149\uc785\ub2c8\ub2e4.\n\"Teacher forcing\"\uc744 \uc0ac\uc6a9\ud558\uba74 \uc218\ub834\uc774 \ube68\ub9ac\ub418\uc9c0\ub9cc [\ud559\uc2b5\ub41c \ub124\ud2b8\uc6cc\ud06c\uac00\n\uc798\ubabb \uc0ac\uc6a9\ub420 \ub54c \ubd88\uc548\uc815\uc131\uc744 \ubcf4\uc785\ub2c8\ub2e4.](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.378.4095&rep=rep1&type=pdf)_.\n\nTeacher-forced \ub124\ud2b8\uc6cc\ud06c\uc758 \ucd9c\ub825\uc774 \uc77c\uad00\ub41c \ubb38\ubc95\uc73c\ub85c \uc77d\uc9c0\ub9cc \uc815\ud655\ud55c\n\ubc88\uc5ed\uacfc\ub294 \uac70\ub9ac\uac00 \uba40\ub2e4\ub294 \uac83\uc744 \ubcfc \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc9c1\uad00\uc801\uc73c\ub85c \ucd9c\ub825 \ubb38\ubc95\uc744\n\ud45c\ud604\ud558\ub294 \ubc95\uc744 \ubc30\uc6b0\uace0 \uad50\uc0ac\uac00 \ucc98\uc74c \uba87 \ub2e8\uc5b4\ub97c \ub9d0\ud558\uba74 \uc758\ubbf8\ub97c \"\uc120\ud0dd\" \ud560 \uc218 \uc788\uc9c0\ub9cc,\n\ubc88\uc5ed\uc5d0\uc11c \ucc98\uc74c\uc73c\ub85c \ubb38\uc7a5\uc744 \ub9cc\ub4dc\ub294 \ubc95\uc740 \uc798 \ubc30\uc6b0\uc9c0 \ubabb\ud569\ub2c8\ub2e4.\n\nPyTorch\uc758 autograd \uac00 \uc81c\uacf5\ud558\ub294 \uc790\uc720 \ub355\ubd84\uc5d0 \uac04\ub2e8\ud55c If \ubb38\uc73c\ub85c\nTeacher Forcing\uc744 \uc0ac\uc6a9\ud560\uc9c0 \uc544\ub2c8\uba74 \uc0ac\uc6a9\ud558\uc9c0 \uc54a\uc744\uc9c0\ub97c \uc120\ud0dd\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.\n\ub354 \ub9ce\uc774 \uc0ac\uc6a9\ud558\ub824\uba74 ``teacher_forcing_ratio`` \ub97c \ud655\uc778\ud558\uc2ed\uc2dc\uc624.\n\n\n"
"### \ubaa8\ub378 \ud559\uc2b5\n\n\ud559\uc2b5\uc744 \uc704\ud574\uc11c \uc778\ucf54\ub354\uc5d0 \uc785\ub825 \ubb38\uc7a5\uc744 \ub123\uace0 \ubaa8\ub4e0 \ucd9c\ub825\uacfc \ucd5c\uc2e0 \uc740\ub2c9 \uc0c1\ud0dc\ub97c\n\ucd94\uc801\ud569\ub2c8\ub2e4. \uadf8\ub7f0 \ub2e4\uc74c \ub514\ucf54\ub354\uc5d0 \uccab \ubc88\uc9f8 \uc785\ub825\uc73c\ub85c ``<SOS>`` \ud1a0\ud070\uacfc\n\uc778\ucf54\ub354\uc758 \ub9c8\uc9c0\ub9c9 \uc740\ub2c9 \uc0c1\ud0dc\uac00 \uccab \ubc88\uc9f8 \uc740\ub2c9 \uc0c1\ud0dc\ub85c \uc81c\uacf5\ub429\ub2c8\ub2e4.\n\n\"Teacher forcing\"\uc740 \ub2e4\uc74c \uc785\ub825\uc73c\ub85c \ub514\ucf54\ub354\uc758 \uc608\uce21\uc744 \uc0ac\uc6a9\ud558\ub294 \ub300\uc2e0\n\uc2e4\uc81c \ubaa9\ud45c \ucd9c\ub825\uc744 \ub2e4\uc74c \uc785\ub825\uc73c\ub85c \uc0ac\uc6a9\ud558\ub294 \ucee8\uc149\uc785\ub2c8\ub2e4.\n\"Teacher forcing\"\uc744 \uc0ac\uc6a9\ud558\uba74 \uc218\ub834\uc774 \ube68\ub9ac\ub418\uc9c0\ub9cc [\ud559\uc2b5\ub41c \ub124\ud2b8\uc6cc\ud06c\uac00\n\uc798\ubabb \uc0ac\uc6a9\ub420 \ub54c \ubd88\uc548\uc815\uc131\uc744 \ubcf4\uc785\ub2c8\ub2e4.](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.378.4095&rep=rep1&type=pdf)_.\n\nTeacher-forced \ub124\ud2b8\uc6cc\ud06c\uc758 \ucd9c\ub825\uc774 \uc77c\uad00\ub41c \ubb38\ubc95\uc73c\ub85c \uc77d\uc9c0\ub9cc \uc815\ud655\ud55c\n\ubc88\uc5ed\uacfc\ub294 \uac70\ub9ac\uac00 \uba40\ub2e4\ub294 \uac83\uc744 \ubcfc \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc9c1\uad00\uc801\uc73c\ub85c \ucd9c\ub825 \ubb38\ubc95\uc744\n\ud45c\ud604\ud558\ub294 \ubc95\uc744 \ubc30\uc6b0\uace0 \uad50\uc0ac\uac00 \ucc98\uc74c \uba87 \ub2e8\uc5b4\ub97c \ub9d0\ud558\uba74 \uc758\ubbf8\ub97c \"\uc120\ud0dd\" \ud560 \uc218 \uc788\uc9c0\ub9cc,\n\ubc88\uc5ed\uc5d0\uc11c \ucc98\uc74c\uc73c\ub85c \ubb38\uc7a5\uc744 \ub9cc\ub4dc\ub294 \ubc95\uc740 \uc798 \ubc30\uc6b0\uc9c0 \ubabb\ud569\ub2c8\ub2e4.\n\nPyTorch\uc758 autograd \uac00 \uc81c\uacf5\ud558\ub294 \uc790\uc720 \ub355\ubd84\uc5d0 \uac04\ub2e8\ud55c If \ubb38\uc73c\ub85c\nTeacher Forcing\uc744 \uc0ac\uc6a9\ud560\uc9c0 \uc544\ub2c8\uba74 \uc0ac\uc6a9\ud558\uc9c0 \uc54a\uc744\uc9c0\ub97c \uc120\ud0dd\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.\n\ub354 \ub9ce\uc774 \uc0ac\uc6a9\ud558\ub824\uba74 ``teacher_forcing_ratio`` \ub97c \ud655\uc778\ud558\uc2ed\uc2dc\uc624.\n\n\n"
]
},
{
Expand Down Expand Up @@ -423,7 +423,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.16"
"version": "3.8.10"
}
},
"nbformat": 4,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -173,7 +173,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
".. figure:: /_static/img/model-parallel-images/split_size_tradeoff.png\n :alt:\n\n\uc2e4\ud5d8 \uacb0\uacfc, ``split_size`` \ub9e4\uac1c\ubcc0\uc218\uac12\uc744 12\ub85c \uc124\uc815\ud558\uc600\uc744 \ub54c, \ud559\uc2b5 \uc2dc\uac04\uc774 54% \uc218\uc900\uc73c\ub85c\n\uac00\uc7a5 \ub9ce\uc774 \ub2e8\ucd95\ub418\uc5c8\uc2b5\ub2c8\ub2e4. \uc544\uc9c1 \ud559\uc2b5 \uc2dc\uac04\uc744 \ub354 \ub2e8\ucd95\uc2dc\ud0ac \uc218 \uc788\ub294 \ubc29\ubc95\uc740 \ub2e4\uc591\ud558\uac8c \uc874\uc7ac\ud569\ub2c8\ub2e4.\n\uc608\ub97c \ub4e4\uc5b4, \uccab \ubc88\uc9f8 GPU\uc5d0\uc11c \ubaa8\ub4e0 \uc5f0\uc0b0\uacfc\uc815\uc774 \uae30\ubcf8\uc73c\ub85c \uc124\uc815\ub418\uc5b4 \uc9c4\ud589\ub429\ub2c8\ub2e4. \uc774\ub294 \ubbf8\ub2c8\ubc30\uce58 \ubd84\ud560 \uacfc\uc815 \uc911,\n\ud604\uc7ac \uc9c4\ud589\ub418\ub294 \uacfc\uc815\uc758 \ub2e4\uc74c \ub2e8\uacc4\ub294 \ud604\uc7ac \uc9c4\ud589\ub418\ub294 \uacfc\uc815\uacfc \ub3d9\uc2dc\uc5d0 \ubcf5\uc81c\uac00 \uc774\ub8e8\uc5b4\uc9c8 \uc218 \uc5c6\ub294 \uac83\uc744 \uc758\ubbf8\ud569\ub2c8\ub2e4.\n\uadf8\ub7ec\ub098, \uc774\uc804\uacfc \ub2e4\uc74c \ub2e8\uacc4\uc758 \ubd84\ud560\uacfc\uc815\uc774 \ub2e4\ub978 \ud150\uc11c\uac12\uc744 \uc774\uc6a9\ud558\uae30 \ub54c\ubb38\uc5d0, \ub2e4\ub978 \uacc4\uc0b0\uacfc \uc911\ubcf5\ub418\uc5b4 \uc9c4\ud589\ub418\uc5b4\ub3c4\n\ubb38\uc81c\uac00 \uc5c6\uc2b5\ub2c8\ub2e4. \uc774\uc5d0 \ub300\ud574\uc11c, 2\uac1c GPU\uc5d0 \uc5ec\ub7ec\uac1c\uc758 \uc2a4\ud2b8\ub9bc\uc744 \uc0ac\uc6a9\ud558\ub294 \uac83\uc774 \ud544\uc694\ud558\uba70, \uc11c\ub85c \ub2e4\ub978 \uc11c\ube0c \ub124\ud2b8\uc6cc\ud06c\n\uad6c\uc870\uac00 \uc11c\ub85c \ub2e4\ub978 \uc2a4\ud2b8\ub9bc\uc744 \uad00\ub9ac\ud558\ub294 \uc804\ub7b5\uc774 \uc694\uad6c\ub429\ub2c8\ub2e4. \ubaa8\ub378 \ubcd1\ub82c \ucc98\ub9ac\uc5d0 \ub300\ud574\uc11c \uc5ec\ub7ec \uc2a4\ud2b8\ub9bc\uc744 \uc0ac\uc6a9\ud558\ub294 \ubc29\ubc95\uc774\n\uc77c\ubc18\uc801\uc744\ub85c \uc874\uc7ac\ud558\uc9c0 \uc54a\uae30 \ub54c\ubb38\uc5d0 \uc774\ubc88 \ud29c\ud1a0\ub9ac\uc5bc\uc5d0\uc11c\ub294 \uc124\uba85\ud558\uc9c0 \uc54a\uc2b5\ub2c8\ub2e4.\n\n"
".. figure:: /_static/img/model-parallel-images/split_size_tradeoff.png\n :alt:\n\n\uc2e4\ud5d8 \uacb0\uacfc, ``split_size`` \ub9e4\uac1c\ubcc0\uc218\uac12\uc744 12\ub85c \uc124\uc815\ud558\uc600\uc744 \ub54c, \ud559\uc2b5 \uc2dc\uac04\uc774 54% \uc218\uc900\uc73c\ub85c\n\uac00\uc7a5 \ub9ce\uc774 \ub2e8\ucd95\ub418\uc5c8\uc2b5\ub2c8\ub2e4. \uc544\uc9c1 \ud559\uc2b5 \uc2dc\uac04\uc744 \ub354 \ub2e8\ucd95\uc2dc\ud0ac \uc218 \uc788\ub294 \ubc29\ubc95\uc740 \ub2e4\uc591\ud558\uac8c \uc874\uc7ac\ud569\ub2c8\ub2e4.\n\uc608\ub97c \ub4e4\uc5b4, \uccab \ubc88\uc9f8 GPU\uc5d0\uc11c \ubaa8\ub4e0 \uc5f0\uc0b0\uacfc\uc815\uc774 \uae30\ubcf8\uc73c\ub85c \uc124\uc815\ub418\uc5b4 \uc9c4\ud589\ub429\ub2c8\ub2e4. \uc774\ub294 \ubbf8\ub2c8\ubc30\uce58 \ubd84\ud560 \uacfc\uc815 \uc911,\n\ud604\uc7ac \uc9c4\ud589\ub418\ub294 \uacfc\uc815\uc758 \ub2e4\uc74c \ub2e8\uacc4\ub294 \ud604\uc7ac \uc9c4\ud589\ub418\ub294 \uacfc\uc815\uacfc \ub3d9\uc2dc\uc5d0 \ubcf5\uc81c\uac00 \uc774\ub8e8\uc5b4\uc9c8 \uc218 \uc5c6\ub294 \uac83\uc744 \uc758\ubbf8\ud569\ub2c8\ub2e4.\n\uadf8\ub7ec\ub098, \uc774\uc804\uacfc \ub2e4\uc74c \ub2e8\uacc4\uc758 \ubd84\ud560\uacfc\uc815\uc774 \ub2e4\ub978 \ud150\uc11c\uac12\uc744 \uc774\uc6a9\ud558\uae30 \ub54c\ubb38\uc5d0, \ub2e4\ub978 \uacc4\uc0b0\uacfc \uc911\ubcf5\ub418\uc5b4 \uc9c4\ud589\ub418\uc5b4\ub3c4\n\ubb38\uc81c\uac00 \uc5c6\uc2b5\ub2c8\ub2e4. \uc774\uc5d0 \ub300\ud574\uc11c, 2\uac1c GPU\uc5d0 \uc5ec\ub7ec\uac1c\uc758 \uc2a4\ud2b8\ub9bc\uc744 \uc0ac\uc6a9\ud558\ub294 \uac83\uc774 \ud544\uc694\ud558\uba70, \uc11c\ub85c \ub2e4\ub978 \uc11c\ube0c \ub124\ud2b8\uc6cc\ud06c\n\uad6c\uc870\uac00 \uc11c\ub85c \ub2e4\ub978 \uc2a4\ud2b8\ub9bc\uc744 \uad00\ub9ac\ud558\ub294 \uc804\ub7b5\uc774 \uc694\uad6c\ub429\ub2c8\ub2e4. \ubaa8\ub378 \ubcd1\ub82c \ucc98\ub9ac\uc5d0 \ub300\ud574\uc11c \uc5ec\ub7ec \uc2a4\ud2b8\ub9bc\uc744 \uc0ac\uc6a9\ud558\ub294 \ubc29\ubc95\uc774\n\uc77c\ubc18\uc801\uc73c\ub85c \uc874\uc7ac\ud558\uc9c0 \uc54a\uae30 \ub54c\ubb38\uc5d0 \uc774\ubc88 \ud29c\ud1a0\ub9ac\uc5bc\uc5d0\uc11c\ub294 \uc124\uba85\ud558\uc9c0 \uc54a\uc2b5\ub2c8\ub2e4.\n\n"
]
},
{
Expand Down Expand Up @@ -204,7 +204,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.16"
"version": "3.8.10"
}
},
"nbformat": 4,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.16"
"version": "3.10.11"
}
},
"nbformat": 4,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -316,7 +316,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.16"
"version": "3.8.10"
}
},
"nbformat": 4,
Expand Down
Loading

0 comments on commit dfc7f1e

Please sign in to comment.