Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement file storage on Google Cloud #11

Open
m-mohr opened this issue Nov 2, 2018 · 1 comment
Open

Implement file storage on Google Cloud #11

m-mohr opened this issue Nov 2, 2018 · 1 comment
Assignees
Labels
architecture enhancement New feature or request

Comments

@m-mohr
Copy link
Member

m-mohr commented Nov 2, 2018

Currently, the driver has its own file storage, but GEE uses Google Cloud Storage. We should try to find a way to connect to the Google Cloud Storage and not use our proprietary implementation as this limits us in importing and exporting files before/after data processing. I'll probably need some help from the GEE engineers to figure out the details. We are already connected to a GCS bucket using the package "@google-cloud/storage", which is used to download the dataset catalogue. Maybe we can re-use that library.

@edzer
Copy link
Member

edzer commented Nov 3, 2018

More in general, effective clouds use some kind of special storage; aws e.g. S3. I believe S3 is also found in non-aws clouds.

@m-mohr m-mohr changed the title File storage Implement file storage on Google Cloud Jan 18, 2024
@m-mohr m-mohr self-assigned this Jan 18, 2024
@m-mohr m-mohr added this to the v1.0 / OSPD milestone Jan 18, 2024
@m-mohr m-mohr removed the prio: high label Jul 30, 2024
@m-mohr m-mohr removed this from the v1.0 / OSPD milestone Jul 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
architecture enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants