Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove the generation of Ivy dependencies.html files #6031

Merged
merged 1 commit into from
May 29, 2019

Conversation

sbesson
Copy link
Member

@sbesson sbesson commented May 21, 2019

With the recent work on OMERO 5.5, these files currently weigh 169M out of 480M for the complete server bundle. In addition to being extremely large, their size makes them almost non-usable.

Proposed changes

These generation of dependencies.html using the Ivy report tasks was introduced in 5a8db9c as part of the decoupling of Bio-Formats. For developers and especially for reviewing dependencies, having the dependency tree under some form and being able to review the version evictions still remains a useful resource. However, having it large HTML files as part of every bundle feels unnecessary.

Testing

Without this PR, a build server (or the last 5.5.0 milestone) zip should be ~160MB or 480MB unzipped. With it included, the size should be largely reduced.

With the recent work on OMERO 5.5, these files currently weight 169M out of
480M for the complete server bundle. In addition to being extremely large,
their size makes them almost non-usable.
@jburel
Copy link
Member

jburel commented May 27, 2019

From the discussion we had, this PR did not have the expected size reduction.

@sbesson
Copy link
Member Author

sbesson commented May 27, 2019

Finally managed to spend a bit of time on it:

sbesson@ls30630:Downloads $ du -csh OMERO.server-5.5.0-rc1-*
310M	OMERO.server-5.5.0-rc1-56-71c02ab-ice36-b39
272M	OMERO.server-5.5.0-rc1-56-71c02ab-ice36-b39.zip
481M	OMERO.server-5.5.0-rc1-ice36-b116
273M	OMERO.server-5.5.0-rc1-ice36-b116.zip

So this PR does not save much in terms of bundled server size (assuming most of the generated HTML are easily compressed) but it still saves ~170M when uncompressing the bundles.

Size being one aspect, another point for discussion is the usability of these files. I initially tried to use them to troubleshoot some dependency conflict/eviction. But it turns out the size makes these reports barely usable as they are (and I could not find an option to shorten the report).

@mtbc
Copy link
Member

mtbc commented May 27, 2019

I've found them useful for checking for conflicts and their outcome so it's nice they can be generated but I don't see why they need to be packaged in the artifact and I guess Ivy's days are numbered anyway.

@mtbc
Copy link
Member

mtbc commented May 27, 2019

(I just do something else while the browser opens the page, then I use ^f to search for what I'm checking.)

@jburel
Copy link
Member

jburel commented May 29, 2019

@mtbc ok to merge this size reduction PR?

@mtbc
Copy link
Member

mtbc commented May 29, 2019

Okay to merge it. RFE to generate but not package it though because the report is useful: for example, just yesterday when I had set OMERO dependencies to 5.5.0-SNAPSHOT instead of the new 5.5.1-SNAPSHOT in testing ome/omero-server#51 dependencies.html substantially assisted the diagnosis.

@sbesson
Copy link
Member Author

sbesson commented May 29, 2019

If the report is still helpful, proposing to move these calls to a separate target that does not copy into the server bundles. Proposing generate-dependencies-report as the target name, other ideas? And should it included in the default build-dev or opt-in?

@mtbc
Copy link
Member

mtbc commented May 29, 2019

All sounds good to me. (Don't mind if it's in default or not.) Fine if it all happens in some follow-up PR next month too. Cheers!

@jburel
Copy link
Member

jburel commented May 29, 2019

Let's open an issue for the generation of report but not packaging of the report

@jburel
Copy link
Member

jburel commented May 29, 2019

Issue created see #6038

@jburel jburel merged commit 3ae4468 into ome:develop May 29, 2019
@jburel jburel added this to the 5.5.0 milestone Jun 13, 2019
@sbesson sbesson deleted the drop_dependencies_report branch June 28, 2022 09:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants