ODC SC Meeting 2020 04 09

Attendees

• Luigi di Fraia (SA Catapult)
• Federica Moscato (SA Catapult)
• Robert Woodcock (CSIRO)
• Syed Rizvi (AMA)
• Paul Haesler (CSIRO)
• Kirill Kouzoubov (GA)
• Tom Butler (GA)
• Andrew Hicks (FrontierSI)
• Randall Sunne (USGS)
• Andrew Cherry (AMA)
• Chris Morgan (FrontierSI)
• Caitlin Adams (FrontierSI)
• Peter Wang (Data61)
• George Dyke (Symbios)

Apologies

• Alex Leith (GA)
• Tony Butzer (USGS)

Minutes

See Google Drive document.

Agenda

• Welcome
• Previous Actions
• State of the Cube
  • CSIRO
    • data-pipeline automated order, cogify and index system moved into the CSIRO EASI Hub k8s deployment. Whilst the original project has now ended a new set of projects are now building on this foundation. It's not ready for general open source release yet but it is being considered by CSIRO.
    • EASI Hub is now running on the official v1.8 release of the datacube-k8s-eks terraform module. Thanks Team CSIRO and GA for the shiny new module.
    • EASI Hub has ported to the new geobuilder build system on Azure DevOps and has the current develop branch of datacube-core and ancillary libraries running in automated Build Pipelines ready for v1.8 release.
    • EASI Hub has seen a modest but steady increase in interest from internal CSIRO users and on the international EASI Hub California deployments.
    • Plans are underway to significantly improve training materials and we'll look forward a way to combine these with some of the others being used (e.g. DEA Sandbox) to create a generic ODC training set/update where applicable. Two issues exist in this regard - use of location, product and band names unique to a deployment environment; Use of Dask in training notebooks.
    • The CSIRO hyperspectral imaging ODC driver development has begun.
      • 2D Zarr driver (Started)
        • No changes to core
        • Supports s3 and disk
        • Flat or nested array structures
      • 2.0 Alpha 3D implementation (planned)
      • 2.0 3D/nD support (planned)
  • Catapult
  • GA
    • .geobox changes are complete. Adopting NetCDF/CF convention for tracking CRS metadata on loaded data. CRS metadata survives many more xarray operations now, unlike previous approach. Better interop with other libraries (xarray.open_dataset).
    • No longer use GDAL python bindings, instead using pyproj+shapely. GDAL python binding are a pain to install and is the most common stumbling point for building a python environment for datacube.
    • Will release 1.8.0rc1 soon.
  • USGS
  • AMA
  • FrontierSI
• Enhancement Proposals
  • New Proposals
  • Committed Proposals
• ODC V1.8 and V2.0
  • ODC datacube-k8s-eks v1.8 tagged and released.
• Other Business
  • ODC 2.0 Index discussions Notes: https://docs.google.com/document/d/1P2_nrHQAJveKQczeKOEpojy5MOhUWC7Rw1QXCvcWrwQ
• Next Meeting and Close
  • TBA

Actions

See the action tracking project.

Outstanding Actions

• Example

New Actions

• Example