ODC SC Meeting 2020 04 09

Attendees

Apologies

Alex Leith (GA)
Tony Butzer (USGS)

Minutes

See Google Drive document.

Agenda

Welcome
Previous Actions
State of the Cube
- CSIRO
  - data-pipeline automated order, cogify and index system moved into the CSIRO EASI Hub k8s deployment. Whilst the original project has now ended a new set of projects are now building on this foundation. It's not ready for general open source release yet but it is being considered by CSIRO.
  - EASI Hub is now running on the official v1.8 release of the datacube-k8s-eks terraform module. Thanks Team CSIRO and GA for the shiny new module.
  - EASI Hub has ported to the new geobuilder build system on Azure DevOps and has the current develop branch of datacube-core and ancillary libraries running in automated Build Pipelines ready for v1.8 release.
  - EASI Hub has seen a modest but steady increase in interest from internal CSIRO users and on the international EASI Hub California deployments.
  - Plans are underway to significantly improve training materials and we'll look forward a way to combine these with some of the others being used (e.g. DEA Sandbox) to create a generic ODC training set/update where applicable. Two issues exist in this regard - use of location, product and band names unique to a deployment environment; Use of Dask in training notebooks.
  - The CSIRO hyperspectral imaging ODC driver development has begun.
    - 2D Zarr driver (Started)
      - No changes to core
      - Supports s3 and disk
      - Flat or nested array structures
    - 2.0 Alpha 3D implementation (planned)
    - 2.0 3D/nD support (planned)
- Catapult
- GA
  - .geobox changes are complete. Adopting NetCDF/CF convention for tracking CRS metadata on loaded data. CRS metadata survives many more xarray operations now, unlike previous approach. Better interop with other libraries (xarray.open_dataset).
  - No longer use GDAL python bindings, instead using pyproj+shapely. GDAL python binding are a pain to install and is the most common stumbling point for building a python environment for datacube.
  - Will release 1.8.0rc1 soon.
- USGS
- AMA
- FrontierSI
Enhancement Proposals
- New Proposals
- Committed Proposals
ODC V1.8 and V2.0
- ODC datacube-k8s-eks v1.8 tagged and released.
Other Business
- ODC 2.0 Index discussions Notes: https://docs.google.com/document/d/1P2_nrHQAJveKQczeKOEpojy5MOhUWC7Rw1QXCvcWrwQ
Next Meeting and Close
- TBA