Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve embedding nets #1414

Open
manuelgloeckler opened this issue Feb 27, 2025 · 0 comments
Open

Improve embedding nets #1414

manuelgloeckler opened this issue Feb 27, 2025 · 0 comments
Labels
embedding_net New default embedding nets enhancement New feature or request hackathon

Comments

@manuelgloeckler
Copy link
Contributor

manuelgloeckler commented Feb 27, 2025

🚀 Feature Request: Pre-configured Embedding Networks for Common Data Types + General data shape support

It would be beneficial to have a suite of pre-configured embedding networks tailored for different data types readily available.

Currently, we provide a set of general methods, which require configuration, or leave it up to the user to choose or develop an appropriate embedding network. For common data types in SBI, it would be great to have several pre-configured networks that require minimal fine-tuning (e.g., users may only need to provide input shapes).

Potential architectures to include:

  • ResNets - For fixed-size inputs
  • 1D CNNs - Suitable for time-series data (optionally with temporal convolution)
  • RNNs - Designed for time-series data
  • Transformers - For permutation-invariant/general tasks i.e. see Add Transformer as embedding net #1413
  • ...

We would like to have a general and "dynamic" data shape support (if combined with a suitable embedding network). There are currently a few redundant shape checks in our pipelines, which should be removed (#1324).

📌 Additional Context

If you identify a reasonable and general use case for a specific architecture and have the expertise to provide default configurations, feel free to create a sub-issue for the network you'd like to implement and begin working on it.

Note: The goal is not to include highly domain-specific architectures that are difficult to maintain.

@manuelgloeckler manuelgloeckler added enhancement New feature or request hackathon embedding_net New default embedding nets labels Feb 27, 2025
@manuelgloeckler manuelgloeckler changed the title Add more preconfigured embedding nets Improve embedding nets Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
embedding_net New default embedding nets enhancement New feature or request hackathon
Projects
None yet
Development

No branches or pull requests

1 participant