Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Google Cloud Storage #176

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -445,6 +445,27 @@ but most panorama images are large enough that a pyramid will be generated.
Note that the `X`, `Y`, and `Z` channels in the raw data are calibration images. While these 3 channels appear first
in the .mcd file, `MCDReader` moves them to the end of the channel list for a better viewing experience in OMERO.

Object Storage
==============

Support for object storage is handled through Java NIO2.
Currently, only the output can be on cloud storage, and `--overwrite` is not supported.

AWS S3
------

S3 support is provided by [s3fs](https://github.com/lasersonlab/Amazon-S3-FileSystem-NIO2/).
Various parameters can be specified through `--output-options`.

Google Cloud Storage (GCS)
--------------------------

Credentials are handled through [Application Default Credentials](https://cloud.google.com/docs/authentication/application-default-credentials).
The credentials used require read/write access to the bucket. (Minimally, this can be `Storage Object Creator`,
`Storage Object Viewer` and `Storage Object Delete`).

`--output-options` are *not* currently supported with GCS.

License
=======

Expand Down
1 change: 1 addition & 0 deletions build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,7 @@ dependencies {
implementation 'javax.xml.bind:jaxb-api:2.3.0'
implementation group: 'ch.qos.logback', name: 'logback-classic', version: '1.3.14'
implementation group: 'ch.qos.logback', name: 'logback-core', version: '1.3.14'
implementation 'com.google.cloud:google-cloud-nio:0.127.26'


implementation 'org.openpnp:opencv:4.7.0-0'
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -128,7 +128,7 @@ public class Converter implements Callable<Integer> {
private volatile Path inputPath;
private volatile String outputLocation;

private Map<String, String> outputOptions;
private Map<String, String> outputOptions = new HashMap<String, String>();
private volatile Integer pyramidResolutions;
private volatile List<Integer> seriesList;

Expand Down