Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

One binary for any goruut use #23

Open
thewh1teagle opened this issue Mar 27, 2025 · 6 comments
Open

One binary for any goruut use #23

thewh1teagle opened this issue Mar 27, 2025 · 6 comments

Comments

@thewh1teagle
Copy link
Contributor

Go usually compiled into tiny binary we can have everything in single binary instead of compile multiple things and running multiple scripts
Regarding embedding of models i would avoid that anyway and let the user wget what he need

@neurlang
Copy link
Owner

Every binary which does inference (like the testing binaries: backtest, homotest, phondephontest, plus production binary: goruut) will be fat (150+MB) because it bundles all the models. For these, this solution will make sense.
Every binary which does training-only (analysis2,...) is slim and will be best left as separate binary in cmd to speed up compilation. Plus that code is not needed for production use, so that's another valuable space we save in production.

@neurlang
Copy link
Owner

Regarding embedding of models we don't have a guaranteed caching directory. Imagine running in browser compiled into wasm (works now) or running in read only filesystem machine where there's really no place to download models to.

@neurlang
Copy link
Owner

Not to mention offline use.

@neurlang neurlang added enhancement New feature or request analysis2 study_language.sh script labels Mar 27, 2025
@thewh1teagle
Copy link
Contributor Author

Regarding embedding of models we don't have a guaranteed caching directory. Imagine running in browser compiled into wasm (works now) or running in read only filesystem machine where there's really no place to download models to.

Then it can be feature flag and identify what's available in runtime

@thewh1teagle
Copy link
Contributor Author

Can we add build.sh instead?

@thewh1teagle
Copy link
Contributor Author

thewh1teagle commented Mar 29, 2025

I would keep this issue for future until some solutions will be find
it will be nice to simplify the end user usage as well the cycle of adding language

@neurlang neurlang added nice to have later and removed enhancement New feature or request analysis2 study_language.sh script labels Mar 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants