Merge pull request #76 from GeoscienceAustralia/dataset_maturity

Add dataset maturity filter

Author: vnewey

intertidal/elevation.py

@@ -1144,6 +1144,7 @@ def intertidal_cli(
             filter_gqa=True,
             max_cloudcover=90,
             skip_broken_datasets=True,
+            dataset_maturity="final",
         )
         satellite_ds.load()
 

requirements.in

@@ -3,7 +3,7 @@ aiohttp
 botocore
 click==8.1.3
 datacube[s3,performance]==1.8.13
-dea-tools==0.3.2.dev49
+dea-tools==0.3.2.dev54
 eodatasets3==0.30.2
 geopandas==0.13.2
 matplotlib==3.7.1

tests/README.md

@@ -10,7 +10,7 @@ Integration tests
 
 This directory contains tests that are run to verify that DEA Intertidal code runs correctly. The ``test_intertidal.py`` file runs a small-scale full workflow analysis over an intertidal flat in the Gulf of Carpentaria using the DEA Intertidal [Command Line Interface (CLI) tools](../notebooks/Intertidal_CLI.ipynb), and compares these results against a LiDAR validation DEM to produce some simple accuracy metrics.
 
-The latest integration test completed at **2024-03-13 11:54**. Compared to the previous run, it had an:
+The latest integration test completed at **2024-03-14 12:50**. Compared to the previous run, it had an:
 - RMSE accuracy of **0.14 m ( :heavy_minus_sign: no change)**
 - MAE accuracy of **0.12 m ( :heavy_minus_sign: no change)**
 - Bias of **0.12 m ( :heavy_minus_sign: no change)**

tests/validation.csv

@@ -45,3 +45,5 @@ time,Correlation,RMSE,MAE,R-squared,Bias,Regression slope
 2024-03-08 04:13:32.992746+00:00,0.975,0.141,0.121,0.95,0.116,1.11
 2024-03-12 05:16:34.997844+00:00,0.975,0.141,0.121,0.95,0.116,1.11
 2024-03-13 00:54:01.731099+00:00,0.975,0.141,0.121,0.95,0.116,1.11
+2024-03-13 23:17:46.582372+00:00,0.975,0.141,0.121,0.95,0.116,1.11
+2024-03-14 01:50:20.512235+00:00,0.975,0.141,0.121,0.95,0.116,1.11