Releases: sertit/eoreader
Releases · sertit/eoreader
v0.19.3
0.19.3 (2023-03-24)
Bug Fixes
- FIX: Fixing
Custom Stacks
when specifyingdatetime=None
on creation - FIX: Fix regression for multi-swath DGM CSK data (huge region) (#78)
- FIX: Fix calibration issues with CSK HR data (using fallback GPT graph by default)
Other
- OPTIM: Always use chunks when reading rasters (#58)
- OPTIM: Speed up VRT virtual warping
- OPTIM: Better management of dask's usage
- CI: Fix projection STAC extension's new version number (1.1.0)
v0.19.2
0.19.2 (2023-02-23)
Bug Fixes
- FIX: Fixing stack when saved as integer for some special cases
- FIX: Clipping negative reflectances to 0 (#79)
- FIX: Fixing nodata mangement for Theia product
- FIX: Fixing handling of SCS multi-swath
Cosmo-SkyMed
products (#78) - FIX: Writing spectral indices on disk to align with other bands (#80)
- FIX: By default, calibration is not applied to slant range
CSG
data, avoiding producing an empty raster (#48)
Other
- OPTIM: Using warped VRT instead of reprojecting DEM/VHR stacks to UTM (#58)
- TYP: Fixing typos in typing
- INTERNAL: Moving
EOREADER_NAME
andDATETIME_FMT
into__init__.py
- INTERNAL: Moving stacking function into
utils
- INTERNAL: Removing unused
cache_property
decorator - INTERNAL: Factorizing
_load
function - CI: Using
assert_raster_almost_equal_magnitude
in CI to better check according to bands' content (sertit 1.24.0) - DEPS: Officially handling Python 3.11 (adding weekly tests on Python 3.11) (#71)
- DOC: Updating
Custom
notebook - DOC: Updating jupyter cache to match new way of handling outputs in readthedocs
v0.19.1
0.19.1 (2023-01-12)
Bug Fixes
- FIX: Fixing a bug for DIMAP V2 products whith GML masks opening without CRS: assigning first the raw CRS before converting to the product's CRS
- FIX: Fixing index creation when exotic bands not handled by ASI have been loaded in the same time (i.e. stacking
NDWI
withOa21
band)
Other
- CLEAN: Removing useless GCP functions regarding Sentinel-3 data
- DOC: Adding a
Remove Clouds
notebook - LIB: Pinning
sertit
to 1.22.0 - CI: Don't run tests when only
__init__
or__meta__
is updated - CI: Some factorizing in
gitlab-ci
v0.19.0
0.19.0 (2023-01-03)
Enhancements
- ENH: Adding the support of Capella constellation (#74)
- ENH: Allow the user to load bands with a window (pixels and geo) (#25, notebook)
Bug Fixes
- FIX: Fix extent computation for
CSG
products with Shapely 2.0 - FIX: Shapely 2.0 deprecation warnings
Other
- DEPR: Add deprecation warning for EOReader spectral indices (used for legacy in 0.18.0) that are aliases of ASI names (#72):
AFRI_1_6
:AFRI1600
,AFRI_2_1
:AFRI2100
,BSI
:BI
,NDGRI
:NGRDI
,NDRE1
:NDREI
,RGI
:RGRI
,WV_BI
:NHFD
,WI
:WI2015
,RDI
:DSI
,DSWI
:DSWI5
,GRI
:DSWI4
,WV_SI
:NDSIWV
,PANI
:BITM
- DOC: Changing copyright from 2022 to 2023
v0.18.1
0.18.1 (2022-12-08)
Bug Fixes
- FIX: Fix regression for missing EOReader aliases for
spyndex
spectral indices
Other
- DOC: Add latest DOI link
v0.18.0
0.18.0 (2022-12-06)
Breaking Changes
- BREAKING CHANGES: Refactoring spectral indices management (#47)
- Using spyndex library, allowing to use all spectral indices
listed here - SAR products may now compute indices if possible (see this list)
- Old EOReader indices are still available for legacy purposes, with some changes:
- For Sentinel-2 data, the band
NIR
andNARROW_NIR
may be interchanged for some index (
see this discussion) - OSAVI formula has changed to stick with the original paper definition (see issue)
NDRE2/3
formula are fixed, now usingVRE_2/3
andNDRE1
corresponds toNDREI
and usesVRE_1
CI1
is renamedCI32
andCI2
is renamedCI21
for readability purposesNDWI21
can be writtenNDWI2100
for homogeneity purposesRDI
(orDSI
) uses nowSWIR_1
instead ofSWIR_2
(see this issue)PANI
equivalent is nowBITM
and is normalised ! (divided by 3)SBI
is normalized (divided by 2) to fit withBIXS
definition- ⚠ You may need to install the last
spyndex
directly from GitHub latest version to have all available indices
- For Sentinel-2 data, the band
- Using spyndex library, allowing to use all spectral indices
- BREAKING CHANGES: Using
pyresample
to geocode Sentinel-3 data (#55)- Cleaner: better conversion from swath to grid
- Faster: Up to 4 times faster
- Allows code refactoring between OLCI and SLSTR
- BREAKING CHANGES: For SAR product types that are not available in the Data Access Portfolio, default resolution is now the pixel spacing instead of the rg x az resolution
- Changes mainly Sentinel-1 default resolutions (except from IW mode)
Enhancements
- ENH: Adding the support of Harmonized Landsat-Sentinel constellation (#49)
- ENH: Adding the support of GEOSAT-2 constellation (#59)
Bug Fixes
- FIX: Fixing
CustomProduct
initialization when fields are set to None (instead of not declaring them) - FIX: SNAP cannot handle float predictors other than 1! Set it to 1 when saving ortho SAR images to disk, in order for SNAP to be able to despeckle
them (https://forum.step.esa.int/t/exception-found-when-reading-compressed-tif/654/7). (#62) - FIX: Fixing mix in
Sentinel-2
mapping forB8
(NIR
, 10m resolution, large spectral bandwidth) andB8A
(NARROW_NIR
, 20m resolution, narrow spectral bandwidth)
Other
- DOC: Add FAQ entry concerning SAR constellations extent KML files failing to be read (TLDR: needs
ogr2ogr
in your
PATH) - DOC: Add Technical Note published in Remote Sensing MDPI in Readme
- DOC: Update optical band mapping graphs (fix regression to 0.15.0 supported constellation)
- DOC: Add information about DEM management in SAR notebook (#61)
- DOC: Updating indices paragraphs
- CI: Using actions/checkout@v3
- CI: Updating versions of pre-commit hooks
- LIBS: Updating
requirements.txt
andsetup.py
to addpyresample
andzarr
v0.17.0
0.17.0 (2022-10-12)
Enhancements
- ENH: Adding the support of RapidEye constellation
- ENH: Handling Planet data with multiple subdatasets (#45)
- ENH: Adding the support of Landsat Level-2 products (#49)
- ENH: Adding the support of Pleides Neo SEN and PRJ products (needs GDAL 3.5+ or rasterio 1.3.0+)
- ENH: Adding the function
bands.is_thermal_band
- ENH: Adding the ability for optical custom stacks to load indices
- ENH: Adding BAIM (MODIS Burned Area Index) spectral index
- ENH: Better management of raw units of the bands of optical products
- ENH: Copying files from
tmp_process
when changing product's output
Bug Fixes
- FIX: Stacks saved as integers on disk keep their original dtype (float32) in Python
- FIX: Stacks with bands loaded "as is" are correctly saved as integers on disk (#52)
- FIX: Using stack CRS (if projected) for
DIMAP
products instead of recomputing from lat/lon, solving potential discrepencies between stack and product CRS - FIX: Workaround for JP2 bug when updating an existing raster (maybe related to this bug)
- FIX: Better management of SkySat datetime conversion from JSON to XML (deterministic way)
- FIX: Fixing computation of invalid pixels for
Sentinel-2
andDIMAP
products (do not remove straylight mask) - FIX: Fixing reprojection resolution of VHR data
- FIX: Computing Brightness Temperature of
Landsat
TIR bands instead of leaving them as is - FIX: Better management of Landsat Instrument values
- FIX: Better radiometry attribute (adding
brightness temperature
andreflectance and brightness temperature
values) - FIX: Changing
Brilliance Temperature
to the correctBrightness Temperature
- FIX: Fixing pandas FutureWarning
The frame.append method is deprecated and will be removed from pandas in a future version.
- FIX: Fixing DeprecationWarning
invalid escape sequence \.
- FIX: Manage correctly Planet dubious pixels (especially for 8 bands products)
Optimizations
- OPTIM: Reduce memory usage when updating all the bands attributes
- OPTIM: Reduce memory usage when stacking as integers
Other
- DOC: Add the need of using SNAP 8.0 up-to-date or SNAP 9.0 (#42)
- DOC: Add the STAC session in API documentation
- DOC: Add warnings for shifts when orthorectifying DIMAP SEN products (using RPCs) (#53)
- DOC: Add limitations to custom stacks
- DEPS: Dropping support of Python 3.7 (#18)
- DEPS: Update minimum version of libs (geopadans 0.11.0+, rasterio 1.3.0+...)
v0.16.1
0.16.1 (2022-08-03)
Bug Fixes
- FIX: Add the missing conversion to reflectance for
Sentinel-3 OLCI
- FIX: Better condition for the conversion to reflectance for
Sentinel-2 THEIA
- FIX: Add logs for
SkySat
data that cannot been converted to reflectance and fix theradiometry
field of its band xarrays - FIX: Add the correct nodata (when overridden by the user) to stacks saved as uint16
Optimizations
- OPTIM: Reduce memory usage during stacking
Other
- CI: Test reflectance values
v0.16.0
0.16.0 (2022-08-01)
Enhancements
- ENH: Adding the support of SuperView-1 constellation (#21)
- ENH: Adding the support of SPOT-4/5 constellations (#39)
- ENH: Allow the possibility to pass a constellation (or a constellation list) to
Reader().open()
to speed up the opening of a product - ENH: Add a quicklook search for
Sentinel-3
products
Bug Fixes
- FIX: Fix quicklook media type with
JP2
files - FIX: Fix
Sentinel-3 SLSTR
F1
bands based on F grid - FIX: Correct the UTM projection for
Sentinel-3
data - FIX: Fix handling of zipped
Sentinel-2 L2Ap
- FIX: Fix zipped
Sentinel-2
with other XML files in GRANULE subdirectories
Other
- Renaming
master
branch tomain
v0.15.1
0.15.1 (2022-06-02)
Optimizations
- OPTIM: Try to create
Vision-1
footprint from the preview file instead of from the stack. - OPTIM: Create footprints for stacked products (i.e.
Maxar
,SkySat
,Custom
...) without mask by opening only the first band of the stack - OPTIM: Create footprints for
Maxar
Products with a resolution 10 times lower. - OPTIM: Footprints have now maximum 50 vertices in order to avoid pixelized footprints
Bug Fixes
- FIX: Fixing condensed name to avoid duplicates:
- adding the
job_id
forVHR
products - adding the polarization channels for
SAR
products
- adding the
- FIX: Remove import of pystac in
stac_utils
- FIX: Fix bug for
Vision-1
data looking for non-existing RPC files in case ofORTP
product type - FIX: Fix quicklook regex for
Vision-1
data - FIX: Fix regex for raw bands for extracted
Sentinel-3 OLCI
products - FIX: Fix
PlanetScope
identifying regex to handle products with a satellite_id containing a letter - FIX: Force metadata regex for
Maxar
products to look for a file with pattern{name}.XML
to avoid other misplaced XML to be found in place of the true XML. - FIX: Fix regression for
Landsat-7
footprint - FIX: Manage the case with
cloud_cover = -999.0
forMaxar
products (returnsNone
)
Other
- CI: Add new optical products to be tested for end-to-end tests