Releases: Flowminder/FlowKit
Releases · Flowminder/FlowKit
1.20.0
Changed
- Updated flowpyter-task to 1.1.0
Removed
- Removed AutoFlow. #6394
What's Changed
- Bump prettier from 3.0.3 to 3.1.0 in /flowauth/frontend by @dependabot in #6400
- Bump numpy from 1.25.2 to 1.26.2 in /flowdb/testdata/synthetic_data by @dependabot in #6403
- Bump pandas from 2.1.2 to 2.1.3 in /flowdb/testdata/synthetic_data by @dependabot in #6402
- Bump cypress from 13.5.0 to 13.5.1 in /flowauth/frontend by @dependabot in #6404
- Bump deps and pin base images by @jc-harrison in #6406
- Bump cypress from 13.5.1 to 13.6.0 in /flowauth/frontend by @dependabot in #6408
- Bump flowpyter-task to 1.1.0 by @greenape in #6409
Full Changelog: 1.19.1...1.20.0
1.19.1
Added
- flowpyter-task now included in the flowetl image
What's Changed
- Bump black from 23.10.1 to 23.11.0 in /flowdb by @dependabot in #6396
- Bump cypress from 13.3.3 to 13.5.0 in /flowauth/frontend by @dependabot in #6397
- Remove AutoFlow by @jc-harrison in #6395
- Bump actions/checkout from 2 to 4 by @dependabot in #6398
- Bump python deps and Airflow by @jc-harrison in #6393
- Adding flowpytertask to flowetl requirements by @Thingus in #6286
Full Changelog: 1.19.0...1.19.1
1.19.0
Added
- FlowETL now updates a new table
events.location_ids
each time a new day of CDR data is ingested, to record the first and last date that each location ID appears in the data. #5376 - New FlowETL QA check "count_locatable_events", which counts the number of added rows with location ID corresponding to a cell with a known location. #5289
- flowkit_jwt_generator is now published as a wheel via pypi
What's Changed
- Bump numpy from 1.24.2 to 1.24.3 in /flowmachine by @dependabot in #6077
- Bump pandas from 2.0.0 to 2.0.1 in /flowdb/testdata/synthetic_data by @dependabot in #6081
- Bump pandas from 2.0.0 to 2.0.1 in /flowmachine by @dependabot in #6083
- Bump pandas from 2.0.0 to 2.0.1 in /flowclient by @dependabot in #6082
- Remove quotes from default data path by @Thingus in #6079
- Bump cypress from 12.10.0 to 12.11.0 in /flowauth/frontend by @dependabot in #6085
- Bump prettier from 2.8.7 to 2.8.8 in /flowauth/frontend by @dependabot in #6074
- Bump date-fns from 2.29.3 to 2.30.0 in /flowauth/frontend by @dependabot in #6090
- Bump ipython from 8.12.0 to 8.12.1 in /flowmachine by @dependabot in #6093
- Bump pre-commit from 3.2.2 to 3.3.0 in /flowmachine by @dependabot in #6096
- Bump pre-commit from 3.3.0 to 3.3.1 in /flowmachine by @dependabot in #6097
- Bump flask from 2.2.3 to 2.2.5 in /flowauth by @dependabot in #6098
- Bump ipython from 8.12.1 to 8.12.2 in /flowmachine by @dependabot in #6100
- Bump geopandas from 0.12.2 to 0.13.0 in /flowmachine by @dependabot in #6101
- Bump redis from 4.5.4 to 4.5.5 in /flowmachine by @dependabot in #6103
- Bump ipykernel from 6.22.0 to 6.23.0 in /flowmachine by @dependabot in #6104
- Bump pyjwt from 2.6.0 to 2.7.0 in /flowkit_jwt_generator by @dependabot in #6106
- Bump ipykernel from 6.23.0 to 6.23.1 in /flowmachine by @dependabot in #6112
- Bump pyjwt from 2.6.0 to 2.7.0 in /flowclient by @dependabot in #6107
- Bump pyjwt from 2.6.0 to 2.7.0 in /flowauth by @dependabot in #6108
- Bump pre-commit from 3.3.1 to 3.3.2 in /flowmachine by @dependabot in #6114
- Bump httpx from 0.24.0 to 0.24.1 in /flowclient by @dependabot in #6118
- Bump requests from 2.30.0 to 2.31.0 in /flowmachine by @dependabot in #6122
- Bump cypress from 12.11.0 to 12.13.0 in /flowauth/frontend by @dependabot in #6123
- Bump pytest-cov from 4.0.0 to 4.1.0 in /flowmachine by @dependabot in #6127
- Bump pytest-cov from 4.0.0 to 4.1.0 in /flowclient by @dependabot in #6124
- Bump pytest-cov from 4.0.0 to 4.1.0 in /flowauth by @dependabot in #6126
- Bump pytest-cov from 4.0.0 to 4.1.0 in /flowkit_jwt_generator by @dependabot in #6125
- Bump cachetools from 5.3.0 to 5.3.1 in /flowmachine by @dependabot in #6133
- Bump pyzmq from 25.0.2 to 25.1.0 in /flowmachine by @dependabot in #6134
- Bump pandas from 2.0.1 to 2.0.2 in /flowdb/testdata/synthetic_data by @dependabot in #6136
- Bump pandas from 2.0.1 to 2.0.2 in /flowclient by @dependabot in #6137
- Bump pandas from 2.0.1 to 2.0.2 in /flowmachine by @dependabot in #6138
- Bump cryptography from 40.0.2 to 41.0.0 in /flowkit_jwt_generator by @dependabot in #6140
- Bump cryptography from 40.0.2 to 41.0.0 in /flowauth by @dependabot in #6141
- Bump cryptography from 41.0.0 to 41.0.1 in /flowkit_jwt_generator by @dependabot in #6144
- Bump cryptography from 40.0.2 to 41.0.0 in /deployment by @dependabot in #6145
- Bump cryptography from 41.0.0 to 41.0.1 in /flowauth by @dependabot in #6143
- Bump geopandas from 0.13.0 to 0.13.1 in /flowmachine by @dependabot in #6150
- Fix build issues with synth data and test data flowdb by @greenape in #6163
- Location ids table and locatable events QA check by @jc-harrison in #6164
- Pinning pyyaml in progress by @Thingus in #6259
- Bump click from 8.1.3 to 8.1.6 in /flowkit_jwt_generator by @dependabot in #6227
- Bump cryptography from 41.0.0 to 41.0.3 in /deployment by @dependabot in #6246
- Bump cryptography from 41.0.1 to 41.0.3 in /flowkit_jwt_generator by @dependabot in #6247
- Bump pyotp from 2.8.0 to 2.9.0 in /flowauth by @dependabot in #6241
- Bump pyjwt from 2.7.0 to 2.8.0 in /flowauth by @dependabot in #6228
- Bump certifi from 2023.5.7 to 2023.7.22 in /flowclient by @dependabot in #6237
- Bumping airflow + hash to 2.6.3 by @Thingus in #6258
- Bump pyjwt from 2.7.0 to 2.8.0 in /flowclient by @dependabot in #6229
- Bump respx from 0.20.1 to 0.20.2 in /flowclient by @dependabot in #6231
- Fix inconsistent hashing by @greenape in #6256
- Bump psycopg2 from 2.9.6 to 2.9.7 in /flowauth by @dependabot in #6273
- Bump tornado from 6.3.2 to 6.3.3 in /flowmachine by @dependabot in #6271
- Bump gitpython from 3.1.31 to 3.1.32 in /flowdb/tests by @dependabot in #6262
- Bump deps 20230815 by @greenape in #6274
- Bump argon2-cffi from 21.3.0 to 23.1.0 in /flowauth by @dependabot in #6275
- Bump asciidoctor from 2.0.18 to 2.0.20 in /autoflow by @dependabot in #6116
- Bump redis from 4.6.0 to 5.0.0 in /flowmachine by @dependabot in #6278
- Bump prettier from 2.8.8 to 3.0.1 in /flowauth/frontend by @dependabot in #6252
- Bump cypress from 12.13.0 to 12.17.4 in /flowauth/frontend by @dependabot in #6276
- Bump prettier from 3.0.1 to 3.0.2 in /flowauth/frontend by @dependabot in #6280
- Bump word-wrap from 1.2.3 to 1.2.5 in /flowauth/frontend by @dependabot in #6281
- Bump click from 8.1.6 to 8.1.7 in /flowkit_jwt_generator by @dependabot in #6283
- Bump jest from 29.5.0 to 29.6.3 in /flowauth/frontend by @dependabot in #6287
- Bump jest from 29.6.3 to 29.6.4 in /flowauth/frontend by @dependabot in #6293
- Bump @material-ui/pickers from 3.3.10 to 3.3.11 in /flowauth/frontend by @dependabot in #6294
- Bump pytest from 7.4.0 to 7.4.1 in /flowkit_jwt_generator by @dependabot in #6304
- Bump pandas from 1.3.5 to 2.1.0 in /flowdb/testdata/synthetic_data by @dependabot in #6301
- Bump pre-commit from 3.3.3 to 3.4.0 in /flowmachine by @dependabot in #6306
- Bump gitpython from 3.1.32 to 3.1.34 in /flowdb/tests by @dependabot in #6312
- Bump pytest from 7.4.0 to 7.4.1 in /flowclient by @dependabot in #6305
- Bump ipykernel from 6.25.1 to 6.25.2 in /flowmachine by @dependabot in #6310
- Bump pytest from 7.4.1 to 7.4.2 in /flowkit_jwt_generator by @dependabot in #6314
- Bump pytest from 7.4.1 to 7.4.2 in /flowclient by @dependabot in #6313
- Bump approvaltests from 8.4.1 to 9.0.0 in /flowmachine by @dependabot in #6296
- Bump black from 23.7.0 to 23.9.1 in /flowdb by @dependabot in #6318
- Bump pytz from 2023.3 to 2023.3.post1 in /flowmachine by @dependabot in #6311
- Bump black from 23.7.0 to 23.9.1 in /flowmachine b...
1.18.4
1.18.3
Added
- Quickstart script now supports arbitrary countries via
EXAMPLE_COUNTRY
env var. #5796 - FlowDB's maximum locks per transaction setting can now be controlled using the
MAX_LOCKS_PER_TRANSACTION
env var. #5157
Changed
- Increased FlowDB's default maximum locks per transaction to
365 * 5 * 4 * (1 + 4)
. #5157
Fixed
- Null values in first column of first row of ingested data no longer cause flowetl to skip ingestion #5090
1.18.2
1.18.1
1.18.0
1.18.0
Added
- Added views
etl.ingested_state
,etl.available_dates
andetl.deduped_post_etl_queries
in FlowDB, for convenient extraction of relevant information from the ETL tables. #5641 - Added
MajorityLocationWithUnlocatable
query class andmajority_location
function. #5720
Changed
- Important; tokens issued by previous versions of Flowauth are not compatible with this version. Users will need to regenerate tokens using the updated Flowauth.
- Move from
groups
toroles
in flowauth; see here for full details. #5613 - Changed
AIRFLOW__CORE__SQL_ALCHEMY_CONN
env var toAIRFLOW__DATABASE__SQL_ALCHEMY_CONN
- RoleScopePicker component redesigned and reimplemented.
- Docs now recommend creating a separate bind mount for airflow scheduler logs, and include this in the secrets quickstart. #3622
jwt
tokens now usesub
instead ofidentity
forJWT_IDENTITY_CLAIM
.- A
majority_location
query withinclude_unlocatable=True
will now include rows for all subscribers in thesubscriber_location_weights
sub-query, including those for whom all weights are negative (previously subscribers with only negative weights were excluded).
Fixed
- Fixed a potential deadlock when using a small connection pool and
store
-ing queries - AutoFlow can now be run in a docker container with non-default user. #5574
- Passing an empty list of events tables when creating a query now raises
ValueError: Empty tables list.
instead of aMissingDateError
. #436 - Flowmachine now looks at only the most recent state (per CDR type per CDR date) in
etl.etl_records
to determine available dates. #5641 - It is now possible to run API queries that include multiple different aggregation units (e.g.
joined_spatial_aggregate
withdisplacement
metric). #4649 - Demo roles can now be used in
worked_examples
. #5735
Removed
- Removed the
include_unlocatable
parameter fromMajorityLocation
class (themajority_location
function should be used instead ifinclude_unlocatable
is required). #5720
1.17.2
Note: This is a side-release for accelerating the Ghana project - please use v. 1.18.0 for work
1.17.2
Added
Changed
- Changed
AIRFLOW__CORE__SQL_ALCHEMY_CONN
env var toAIRFLOW__DATABASE__SQL_ALCHEMY_CONN
- Docs now recommend creating a separate bind mount for airflow scheduler logs, and include this in the secrets quickstart. #3622
- A
majority_location
query withinclude_unlocatable=True
will now include rows for all subscribers in thesubscriber_location_weights
sub-query, including those for whom all weights are negative (previously subscribers with only negative weights were excluded).
Fixed
- Fixed a potential deadlock when using a small connection pool and
store
-ing queries - Added
MajorityLocationWithUnlocatable
query class andmajority_location
function. #5720 - AutoFlow can now be run in a docker container with non-default user. #5574
- Passing an empty list of events tables when creating a query now raises
ValueError: Empty tables list.
instead of aMissingDateError
. #436 - Flowmachine now looks at only the most recent state (per CDR type per CDR date) in
etl.etl_records
to determine available dates. #5641 - It is now possible to run API queries that include multiple different aggregation units (e.g.
joined_spatial_aggregate
withdisplacement
metric). #4649
Removed
- Removed the
include_unlocatable
parameter fromMajorityLocation
class (themajority_location
function should be used instead ifinclude_unlocatable
is required). #5720
1.17.1
Added
- Added
get_aggregation_unit
server action, for getting the aggregation unit associated with a query specification. #5141
Changed
nocturnal_events
now expects anight_hours
parameter with nested sub-fieldsstart_hour
andend_hour
, instead of two parametersnight_start_hour
andnight_end_hour
.- Spatial units with a mapping table now only include cells that appear in the mapping table. #5360
Fixed
- Invalid sub-query specs nested within a
modal_location
spec now raise appropriate validation errors, instead of being masked by internal flowmachine server errors. #4816