Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Learned budget assignments in Volume are softmax normalised #144

Open
GilesStrong opened this issue Oct 28, 2022 · 0 comments
Open

Learned budget assignments in Volume are softmax normalised #144

GilesStrong opened this issue Oct 28, 2022 · 0 comments
Labels
enhancement New feature or request good first issue Good for newcomers idea Something not relevant to current work, but could be useful in the future low priority Should be fixed eventually, but isn't urgent Optimisation Issue affects the optimisation of the detector

Comments

@GilesStrong
Copy link
Owner

Volume.assign_budget takes the learned budget_weights [-inf,inf] and normalises them to sum to 1 via a softmax function.
This has the advantage that the learnable parameters have no constraint on their values (i.e. don't have to be positive).
It does however meant that there is a non-linear relationship between the learned values and the actual budget that each detector receives; which could lead to unpredictable/unexpected behaviour (e.g. panels suddenly becoming very large/small).
Instead I think it might be worth investigating how well the optimisation handles clamping the parameters in [0,inf] and normalising by their sum.

@GilesStrong GilesStrong added enhancement New feature or request good first issue Good for newcomers low priority Should be fixed eventually, but isn't urgent idea Something not relevant to current work, but could be useful in the future Optimisation Issue affects the optimisation of the detector labels Oct 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers idea Something not relevant to current work, but could be useful in the future low priority Should be fixed eventually, but isn't urgent Optimisation Issue affects the optimisation of the detector
Projects
None yet
Development

No branches or pull requests

1 participant