Skip to content

Releases: Flowminder/FlowKit

1.20.0

23 Nov 09:45
7a00a2d
Compare
Choose a tag to compare

Changed

  • Updated flowpyter-task to 1.1.0

Removed

  • Removed AutoFlow. #6394

What's Changed

Full Changelog: 1.19.1...1.20.0

1.19.1

10 Nov 09:24
4d652e4
Compare
Choose a tag to compare

Added

  • flowpyter-task now included in the flowetl image

What's Changed

Full Changelog: 1.19.0...1.19.1

1.19.0

07 Nov 16:44
49bd9e4
Compare
Choose a tag to compare

Added

  • FlowETL now updates a new table events.location_ids each time a new day of CDR data is ingested, to record the first and last date that each location ID appears in the data. #5376
  • New FlowETL QA check "count_locatable_events", which counts the number of added rows with location ID corresponding to a cell with a known location. #5289
  • flowkit_jwt_generator is now published as a wheel via pypi

What's Changed

Read more

1.18.4

19 Apr 09:53
cb66267
Compare
Choose a tag to compare

Changed

  • docker-compose has been replaced with docker compose in the makefile; this might break builds on machines that haven't updated their docker in a while.

Fixed

  • SQLAlchemy version installed in the FlowMachine docker image is now compatible with the flowmachine library. #6052

1.18.3

31 Mar 22:25
47413fc
Compare
Choose a tag to compare

Added

  • Quickstart script now supports arbitrary countries via EXAMPLE_COUNTRY env var. #5796
  • FlowDB's maximum locks per transaction setting can now be controlled using the MAX_LOCKS_PER_TRANSACTION env var. #5157

Changed

  • Increased FlowDB's default maximum locks per transaction to 365 * 5 * 4 * (1 + 4). #5157

Fixed

  • Null values in first column of first row of ingested data no longer cause flowetl to skip ingestion #5090

1.18.2

03 Feb 12:25
35b0511
Compare
Choose a tag to compare

Fixed

  • Fixed migrations being missing from the built FlowAuth docker images #5818

1.18.1

31 Jan 13:03
77aedda
Compare
Choose a tag to compare

1.18.1

Added

  • Added Alembic support via flask-migrate to Flowauth #5799

1.18.0

11 Jan 11:46
d6a4735
Compare
Choose a tag to compare

1.18.0

Added

  • Added views etl.ingested_state, etl.available_dates and etl.deduped_post_etl_queries in FlowDB, for convenient extraction of relevant information from the ETL tables. #5641
  • Added MajorityLocationWithUnlocatable query class and majority_location function. #5720

Changed

  • Important; tokens issued by previous versions of Flowauth are not compatible with this version. Users will need to regenerate tokens using the updated Flowauth.
  • Move from groups to roles in flowauth; see here for full details. #5613
  • Changed AIRFLOW__CORE__SQL_ALCHEMY_CONN env var to AIRFLOW__DATABASE__SQL_ALCHEMY_CONN
  • RoleScopePicker component redesigned and reimplemented.
  • Docs now recommend creating a separate bind mount for airflow scheduler logs, and include this in the secrets quickstart. #3622
  • jwt tokens now use sub instead of identity for JWT_IDENTITY_CLAIM.
  • A majority_location query with include_unlocatable=True will now include rows for all subscribers in the subscriber_location_weights sub-query, including those for whom all weights are negative (previously subscribers with only negative weights were excluded).

Fixed

  • Fixed a potential deadlock when using a small connection pool and store-ing queries
  • AutoFlow can now be run in a docker container with non-default user. #5574
  • Passing an empty list of events tables when creating a query now raises ValueError: Empty tables list. instead of a MissingDateError. #436
  • Flowmachine now looks at only the most recent state (per CDR type per CDR date) in etl.etl_records to determine available dates. #5641
  • It is now possible to run API queries that include multiple different aggregation units (e.g. joined_spatial_aggregate with displacement metric). #4649
  • Demo roles can now be used in worked_examples. #5735

Removed

  • Removed the include_unlocatable parameter from MajorityLocation class (the majority_location function should be used instead if include_unlocatable is required). #5720

1.17.2

11 Jan 10:34
Compare
Choose a tag to compare

Note: This is a side-release for accelerating the Ghana project - please use v. 1.18.0 for work

1.17.2

Added

Changed

  • Changed AIRFLOW__CORE__SQL_ALCHEMY_CONN env var to AIRFLOW__DATABASE__SQL_ALCHEMY_CONN
  • Docs now recommend creating a separate bind mount for airflow scheduler logs, and include this in the secrets quickstart. #3622
  • A majority_location query with include_unlocatable=True will now include rows for all subscribers in the subscriber_location_weights sub-query, including those for whom all weights are negative (previously subscribers with only negative weights were excluded).

Fixed

  • Fixed a potential deadlock when using a small connection pool and store-ing queries
  • Added MajorityLocationWithUnlocatable query class and majority_location function. #5720
  • AutoFlow can now be run in a docker container with non-default user. #5574
  • Passing an empty list of events tables when creating a query now raises ValueError: Empty tables list. instead of a MissingDateError. #436
  • Flowmachine now looks at only the most recent state (per CDR type per CDR date) in etl.etl_records to determine available dates. #5641
  • It is now possible to run API queries that include multiple different aggregation units (e.g. joined_spatial_aggregate with displacement metric). #4649

Removed

  • Removed the include_unlocatable parameter from MajorityLocation class (the majority_location function should be used instead if include_unlocatable is required). #5720

1.17.1

05 Sep 15:58
4703f90
Compare
Choose a tag to compare

Added

  • Added get_aggregation_unit server action, for getting the aggregation unit associated with a query specification. #5141

Changed

  • nocturnal_events now expects a night_hours parameter with nested sub-fields start_hour and end_hour, instead of two parameters night_start_hour and night_end_hour.
  • Spatial units with a mapping table now only include cells that appear in the mapping table. #5360

Fixed

  • Invalid sub-query specs nested within a modal_location spec now raise appropriate validation errors, instead of being masked by internal flowmachine server errors. #4816