Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better NN architectures #1442

Open
3 tasks
manuelgloeckler opened this issue Mar 13, 2025 · 4 comments
Open
3 tasks

Better NN architectures #1442

manuelgloeckler opened this issue Mar 13, 2025 · 4 comments
Assignees
Labels
enhancement New feature or request hackathon score-matching-performance Improving the performance of score- and flow-matching methods

Comments

@manuelgloeckler
Copy link
Contributor

🚀 Feature Request

Unlike NPE, score and flow matching approaches are highly sensitive to the neural network architecture used to estimate the corresponding vector field. It is well-known that diffusion models, for example, tend to work best with specialized architectures like U-Nets for images (and other similarly specialized structures).

Describe the solution you'd like

To address this, the following steps should be completed:

  • Identify suitable neural network architectures that could improve performance for score and flow matching.
  • Implement these architectures and their corresponding network builders (see here).
  • Test whether these new architectures outperform the default MLPs/ResNets. To do so, use the newly introduced mini-sbibm feature (Mini-SBIBM #1325) with pytest --bm or pytest --bm -n for multiprocessing (if you have a capable CPU).

Additional Context

The aim is to enhance the performance of score and flow matching by incorporating more suitable neural network architectures, providing better results than the default MLPs/ResNets currently used.

@manuelgloeckler manuelgloeckler added enhancement New feature or request hackathon score-matching-performance Improving the performance of score- and flow-matching methods labels Mar 13, 2025
@jaivardhankapoor
Copy link
Collaborator

I'd like to tackle this issue. How can I assign myself?

@manuelgloeckler
Copy link
Contributor Author

Assigned you :)

@janfb
Copy link
Contributor

janfb commented Mar 13, 2025

I'd like to tackle this issue. How can I assign myself?

@jaivardhankapoor you should have received an invitation to become external collaborator with Triage rights. This should give you the rights to assign yourself. Can you please check whether this works, e.g., unassigning and re-assigning yourself?

@jaivardhankapoor
Copy link
Collaborator

I'd like to tackle this issue. How can I assign myself?

@jaivardhankapoor you should have received an invitation to become external collaborator with Triage rights. This should give you the rights to assign yourself. Can you please check whether this works, e.g., unassigning and re-assigning yourself?

Yes, I got access now. Thanks :)

@turnmanh turnmanh self-assigned this Mar 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request hackathon score-matching-performance Improving the performance of score- and flow-matching methods
Projects
None yet
Development

No branches or pull requests

4 participants