Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Runs out of memory for large datasets #70

Open
MrPekar98 opened this issue Dec 7, 2021 · 1 comment
Open

Runs out of memory for large datasets #70

MrPekar98 opened this issue Dec 7, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@MrPekar98
Copy link

MrPekar98 commented Dec 7, 2021 •
edited
Loading

When generating embeddings of larger datasets, say 30 GB, I will get an OutOfMemory exception. I run your container from Docker Hub on a server with 2 TB of RAM.

You can add the -Xmx flag when running the .jar file to increase the maximum heap size. For example, -Xmx500g.
@janothan
Copy link
Member

@vemonet - could you take this?

@janothan janothan added the enhancement New feature or request label Feb 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@janothan @MrPekar98