Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

File Limit Request: jaxlib - 200 MiB #5736

Closed
3 tasks done
hawkinsp opened this issue Feb 24, 2025 · 2 comments
Closed
3 tasks done

File Limit Request: jaxlib - 200 MiB #5736

hawkinsp opened this issue Feb 24, 2025 · 2 comments

Comments

@hawkinsp
Copy link

Project URL

https://pypi.org/project/jaxlib

Does this project already exist?

  • Yes

New Limit

200MiB

Update issue title

  • I have updated the title.

Which indexes

PyPI

About the project

jaxlib is the binary library for jax (https://github.com/jax-ml/jax), which is a major machine learning framework. It has been active since around 2019 on pypi.

Our pypi releases are already split into multiple plugin packages to minimize file sizes. For example, jaxlib does not contain any CUDA code, which instead lives in jax-cuda12-pjrt and jax-cuda12-plugin which are plugins for the main jax package. jaxlib contains only the binary code that is common to all users of JAX.

JAX and jaxlib are considerably smaller in binary size than similar frameworks (e.g., torch, tensorflow).

Reasons for the request

Individual wheels were slightly below 100MiB for some time, but the current release is now just over 100MiB (100.3MiB) leading to a broken release where only some of our wheels are uploaded. We can work to reduce our binary size but we have been uncomfortably close to the 100MiB limit for a long time.

If it were possible to address this promptly it would help us and our users.

Code of Conduct

  • I agree to follow the PSF Code of Conduct
@ewdurbin
Copy link
Member

Individual File limit upped to 150MiB.

@ewdurbin
Copy link
Member

Requests like this won't be processed out-of-order once pypi/warehouse#17650 has been closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants