Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TransformerEncoderLayer中的activation激活参数需求。内容很简短烦请请大佬赐教。 #70385

Open
sealoongleft opened this issue Dec 20, 2024 · 0 comments
Open

TransformerEncoderLayer中的activation激活参数需求。内容很简短烦请请大佬赐教。 #70385

sealoongleft opened this issue Dec 20, 2024 · 0 comments
Assignees
@YuanRisheng
Labels
status/new-issue 新建 type/feature-request 新需求申请

Comments

@sealoongleft
Copy link

sealoongleft commented Dec 20, 2024 •
edited
Loading

需求描述 Feature Description

任务目标：

我在使用TransformerEncoderLayer这个api的activation参数时，我需要传入leakyrelu激活函数，但是大佬你知道的，这个激活函数是具有参数的，也就是你们提供的F.leaky_relu或者是nn.LeakeyReLU激活函数的negative_slop参数。
目前这个参数只能传入不带参数的激活函数，或者带默认参数的激活函数。

需求：

如何将设置了negative_slop参数的leakyrelu也传入给TransformerEncoderLayer的activation。

替代实现 Alternatives

No response
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@YuanRisheng YuanRisheng

Labels
status/new-issue 新建 type/feature-request 新需求申请
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@YuanRisheng @sealoongleft