You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi all,
thanks for the amazing work on the CRMint tool, I am using and recommending it a lot! From time to time, I come across situations where I wish I could use it as a pipeline management tool for broader use-cases than what is currently being possible with the integrated workers. For example, I need to pull weather forecast data daily from an API, do some data preparation with Pandas and then import it to BQ to process the data with BQML. The way I'm doing this now is with Cloud Scheduler, Pub/Sub and Cloud Functions, but this is obviously less than ideal for monitoring and error handling.
It would be amazing if there would be a "custom python" worker type in CRMint where I could simply paste my python code for tasks like these and have them as steps of these pipelines.
Thanks a lot!
Martin
The text was updated successfully, but these errors were encountered:
Hi all,
thanks for the amazing work on the CRMint tool, I am using and recommending it a lot! From time to time, I come across situations where I wish I could use it as a pipeline management tool for broader use-cases than what is currently being possible with the integrated workers. For example, I need to pull weather forecast data daily from an API, do some data preparation with Pandas and then import it to BQ to process the data with BQML. The way I'm doing this now is with Cloud Scheduler, Pub/Sub and Cloud Functions, but this is obviously less than ideal for monitoring and error handling.
It would be amazing if there would be a "custom python" worker type in CRMint where I could simply paste my python code for tasks like these and have them as steps of these pipelines.
Thanks a lot!
Martin
The text was updated successfully, but these errors were encountered: