Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to new lambda layers #150

Merged
merged 3 commits into from
Aug 17, 2024
Merged

Switch to new lambda layers #150

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
82968cb
Switch to new lambda layers
dmannarino Aug 16, 2024
a591074
docker-compose -> docker compose
dmannarino Aug 17, 2024
bd97e8c
Add numpy layer zip for tests
dmannarino Aug 17, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions terraform/main.tf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,8 +49,9 @@ module "datapump" {
sfn_wait_time = 120
data_api_uri = var.data_api_uri
data_lake_bucket = data.terraform_remote_state.core.outputs.data-lake_bucket
rasterio_lambda_layer_arn = data.terraform_remote_state.lambda-layers.outputs.py310_rasterio_138_arn
shapely_lambda_layer_arn = data.terraform_remote_state.lambda-layers.outputs.py310_shapely_185_arn
numpy_lambda_layer_arn = data.terraform_remote_state.lambda-layers.outputs.py310_numpy_arn
rasterio_lambda_layer_arn = data.terraform_remote_state.lambda-layers.outputs.py310_rasterio_no_numpy_arn
shapely_lambda_layer_arn = data.terraform_remote_state.lambda-layers.outputs.py310_shapely_no_numpy_arn
glad_path = local.glad_path
emr_instance_profile_name = data.terraform_remote_state.core.outputs.emr_instance_profile_name
emr_service_role_name = data.terraform_remote_state.core.outputs.emr_service_role_name
Expand Down
2 changes: 2 additions & 0 deletions terraform/modules/datapump/lambdas.tf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ resource "aws_lambda_function" "dispatcher" {
tags = local.tags
layers = [
module.py310_datapump_021.layer_arn,
var.numpy_lambda_layer_arn,
var.rasterio_lambda_layer_arn,
var.shapely_lambda_layer_arn
]
Expand Down Expand Up @@ -68,6 +69,7 @@ resource "aws_lambda_function" "postprocessor" {
tags = local.tags
layers = [
module.py310_datapump_021.layer_arn,
var.numpy_lambda_layer_arn,
var.rasterio_lambda_layer_arn,
var.shapely_lambda_layer_arn
]
Expand Down
5 changes: 5 additions & 0 deletions terraform/modules/datapump/variables.tf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,11 @@ variable "sfn_wait_time" {
description = "Time to wait in between steps of step function"
}

variable "numpy_lambda_layer_arn" {
type = string
description = "ARN of the numpy lambda layer"
}

variable "rasterio_lambda_layer_arn" {
type = string
description = "ARN of the rasterio lambda layer"
Expand Down
Loading