Skip to content

DEFRA/flood-data

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Build StatusMaintainabilityTest Coverage

flood-data

Synopsis

This repo contains multiple AWS lambda functions to provide the processing of data files for LFW from FWFI

Lambda Functions

ffoi-process

Pulls in the forcast telemetry data from the S3 bucket and processes it into the database

fgs-process

Lambda that checks for the latest flood guidence statement and if it is newer than the last processed one it will download the file and put it in our S3 bucket

fwis-process

Gets all warnings and alerts from the FWIS api and puts them in the database

imtd-process

This Lambda will check every station in the database agaist the IMTD api and update the database with the latest thresholds for each station. Calling its self after each station in order to minimise the time the lambda runs for. This is run every two weeks and the different envs have to run on different days as the IMTD api cant handle the load of all the stations at once from multiple envs.

rloi-process

brings in the observed telemtery data from the S3 bucket and processes it into the database

rloi-refresh

refreshes the materialized views and clears out the old telemetry.

station-process

Uses the exports context file from sharepoint to update the stations in the database.

Local development

This will use localstack and the supporting files and documentation to follow.

Deployment

This is installed using terraforms/terragrunt which is managed by WebOps

Unit tests and linting

npm run pre-deployment-test

Feature testing (integration)

npm run post-deployment-test