Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

seed-chainstate improvments #111

Open
wileyj opened this issue Jun 22, 2023 · 3 comments
Open

seed-chainstate improvments #111

wileyj opened this issue Jun 22, 2023 · 3 comments
Labels

Comments

@wileyj
Copy link
Collaborator

wileyj commented Jun 22, 2023

from conversation:

ideally it would download, check everything and then stop the containers and replace file

would require some checks to happen when starting (are the services running?)
how to manage the postgres/chainstate data if we leave the services running?

disk space requirements would essentially be doubled plus a little extra for the compressed files.

it's worth looking into, maybe a flag or something?

@wileyj
Copy link
Collaborator Author

wileyj commented Jun 22, 2023

one more caveat to consider - CPU/disk IO.
when version 7 of the API, the cpu/io requirements are quite a bit higher than in the past.

restoring from an archive is very IO intense. maybe a check to see how many cpu's and what the diskops are at currently before even attempting to restore while services are running

@pseudozach
Copy link

from conversation:

ideally it would download, check everything and then stop the containers and replace file

would require some checks to happen when starting (are the services running?) how to manage the postgres/chainstate data if we leave the services running?

disk space requirements would essentially be doubled plus a little extra for the compressed files.

it's worth looking into, maybe a flag or something?

agree this would only be safe if there's plenty of disk space plus some extra room. but it would be useful for minimizing downtime.

an alternative would be a download-only option where the seed-chainstate script would download everything and uncompress but does not replace the persistent-data folder. it would just exit with a sample command like:

seed archive download completed. if you want to migrate to downloaded archive:

  • stop the services
  • rm -rf ./persistent-data
  • mv persistent-data-xxx persistent-data
  • check to ensure file permissions are correct
  • start the services.

or maybe there can be another command to do all of these with a downloaded archive...

just some ideas..

Copy link

stale bot commented Mar 17, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the stale label Mar 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants