Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

find_unused_parameters should be easier to trigger #2924

Open
stephenroller opened this issue Aug 2, 2020 · 0 comments
Open

find_unused_parameters should be easier to trigger #2924

stephenroller opened this issue Aug 2, 2020 · 0 comments
Labels
H2 2020 never-stale

Comments

@stephenroller
Copy link
Contributor

Bug description
In distributed mode, the find_unused_parameters option to DataParallel is currently unable to be overwritten by a user. We should make a helper method in TorchAgent for that, which specific agents can override.

LayerDrop is one example where we will need to turn it on.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
H2 2020 never-stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@stephenroller