wagl is a Python package for producing standarised imagery in the form of:
- Nadir Bi-directional Reflectance Distribution Function Adjusted Reflectance (NBAR)
- NBART; NBAR with Terrain Illumination correction
- Surface Brightness Temperature
- Pixel Quality (per pixel metadata)
The luigi task workflow for producing NBAR for a Landsat 5TM scene is given below.
- Landsat 5 TM
- Landsat 7 ETM
- Landsat 8 OLI
- Landsat 8 TIRS
- Sentinel-2a
- luigi
- numpy
- scipy
- numexpr
- pyephem
- proj
- h5py
- tables
- pandas
- scikit-image
- GDAL
- rasterio
- fiona
- shapely
- geopandas
- pyyaml
- attrs
The wagl pacakage can be installed via:
$ python setup.py install --prefix=<prefix>
Additional compression filters can be used via HDF5's dynamically loaded filters. Essentially the filter needs to be compiled against the HDF5 library, and installed into HDF5's plugin path, or a path of your choosing, and set the HDF5_PLUGIN_PATH environment variable. The filters are then automatically accessible by HDF5 via the integer code assigned to the filter.
Mafisc combines both a bitshuffling filter and lzma compression filter in order
to get the best compression possible at the cost of lower compression speeds.
To install the mafisc
compression filter, follow these instructions.
The bitshuffle filter can be installed from source, or conda via the supplied conda recipe. It utilises a bitshuffling filter on top of either a lz4 or lzf compression filter.
Using the local scheduler:
$ luigi --module wagl.multifile_workflow ARD --workflow NBAR --level1-list scenes.txt --outdir /some/path --local-scheduler --workers 4
Using the central scheduler:
$ luigid --background --pidfile <PATH_TO_PIDFILE> --logdir <PATH_TO_LOGDIR> --state-path <PATH_TO_STATEFILE>
$ luigi --module wagl.multifile_workflow ARD --level1-list scenes.txt --workflow STANDARD --outdir /some/path --workers 4
$ luigi --module wagl.multifile_workflow ARD --level1-list scenes.txt --workflow NBAR --outdir /some/path --workers 4
$ luigi --module wagl.multifile_workflow ARD --level1-list scenes.txt --workflow SBT --outdir /some/path --workers 4