Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix problems with Tinybird deployment #21884

Draft
wants to merge 13 commits into
base: tinybird-add-column-test
Choose a base branch
from

Conversation

FGonzalezLopez
Copy link
Contributor

@FGonzalezLopez FGonzalezLopez commented Dec 13, 2024

The objective of these changes is to enable running these commands without errors:

  • tb branch use main
  • tb branch rm tb_deploy_tinybird_add_column_test
    (Clean up if needed)
  • tb branch create --last-partition --wait tb_deploy_tinybird_add_column_test
  • tb branch use tb_deploy_tinybird_add_column_test
  • tb deploy

This also introduces a tentative "version log" to keep track of the latest deployed version in Tinybird.

I have included the first draft of a "version upgrade script", but I think I have gone overboard with stuff we don't really need, and I am going to cut back its complexity and the amount of stuff that it does. The script has been cut back to a really simple set of commands that perform the necessary data operations.

You can test the version upgrade script with the data migration (after deploying):
First initialize the version_log datasource

  • tb datasource truncate version_log --yes
  • echo "{\"version\":\"0.0.0\",\"step_id\":-1,\"message\":\"Current version statement\"}" > /tmp/msg.ndjson
  • tb datasource append version_log /tmp/msg.ndjson
    Then run the script:
  • sh scripts/version_upgrade.sh

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant