New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

transformer #107

Open

QJShan opened this issue Apr 25, 2023 · 2 comments

QJShan commented Apr 25, 2023

1.为何transformer没有decoder部分
2

这里貌似有点问题。

lc2313445 commented Jun 15, 2023

是的，这个transformer不是很标准，这边应该是四维[batch_size, dim_head, -1, d_k]，而且一般view不会将batch的维度进行变化的。。。emmmm

lc2313445 commented Jun 15, 2023

有些地方view使用的也有点问题啊，作者好像没太弄清楚view和transpose两个的区别。。。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment