Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create cloud function to save county CSV to bucket #61

Closed
1 task
isaacmg opened this issue Jul 1, 2020 · 8 comments
Closed
1 task

Create cloud function to save county CSV to bucket #61

isaacmg opened this issue Jul 1, 2020 · 8 comments
Assignees

Comments

@isaacmg
Copy link
Member

isaacmg commented Jul 1, 2020

  • Deploy cloud function on GCS and test on incoming data.
@efawe efawe self-assigned this Jul 1, 2020
@efawe
Copy link
Contributor

efawe commented Jul 1, 2020

Do we have a county csv already or do we need to aggregate one ?

@isaacmg
Copy link
Member Author

isaacmg commented Jul 1, 2020

So @efawe the main thing for this is to just create a cloud function to split up the data that you persisted in #48. This is currently already done in notebooks but in order to clean up notebooks and have unified county data having separate csv for each county would be useful. Also when we go to deploy the models to production in #60 we will need data persisted on a county level.

@isaacmg
Copy link
Member Author

isaacmg commented Jul 1, 2020

So just modify this function to output a CSV file in the format task_ts/date/county_name.csv to the proper path.

def loop_through_locations(

I've previously developed cloud functions so I might be able to give you some additional code. Just create the cloud function on Google then have it be triggered on finalize.

@efawe
Copy link
Contributor

efawe commented Jul 3, 2020

Figured out cloud functions. Should have the full code in a day

@efawe
Copy link
Contributor

efawe commented Jul 4, 2020

Created the cloud function. How should I add some form of copy on the github?

@isaacmg
Copy link
Member Author

isaacmg commented Jul 5, 2020

@efawe Is it working on GCP? If so open a PR containing the code and the requirements.txt file. Store it a directory in the following way cloud_functions/partition_county/main.py and cloud_functions/partition_county/requirements.txt Thanks.

@efawe
Copy link
Contributor

efawe commented Jul 5, 2020

Yes and will do

@efawe
Copy link
Contributor

efawe commented Jul 11, 2020

Created a separate issue that is more reflective of the development. Currently google cloud functions is not practical financially.
#69 #

@efawe efawe closed this as completed Jul 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants