Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

运行久了后,非常占用硬盘容量 #8

Open
wfce opened this issue Jul 1, 2024 · 2 comments
Open

运行久了后,非常占用硬盘容量 #8

wfce opened this issue Jul 1, 2024 · 2 comments

Comments

@wfce
Copy link

wfce commented Jul 1, 2024

首先感谢大佬的程序,非常好用
但是运行久了后,非常占用硬盘容量,我束手无策
目前只能定期删除重新安装程序,但是太麻烦了,还会影响运行
希望大佬能更新解决这个问题,谢谢!

@MattVieira
Copy link

I have also encountered this issue, which appears to be related to the puppeteer_dev_profile directories.
/var/lib/docker/overlay2/c3e07c5e8c8b3e2823917989e7bcb238e95464a671cfc4818260c8504fdb8749/merged/tmp

At present, I am unable to dedicate sufficient time to find an optimal solution. However, I have devised a workaround by implementing an automated agent that restarts the docker container on an hourly basis.

@reneManqueros
Copy link

You can adjust this:
https://github.com/zfcsoftware/cf-clearance-scraper/blob/main/module/browser.js#L82
to send the profile folder like this:
-user-data-dir=user_data_dirs/{session_id}
this way each folder/request is unique then have some handler to delete them after the disconnect:
https://github.com/zfcsoftware/cf-clearance-scraper/blob/main/module/browser.js#L103
this way you will only have a couple of profiles at the same time.
If you have a LOT of requests then you can group several folders and delete in chunks of 10 or so, this way the IO is reduced.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants