How to download multiple Twitter profiles at once.

[AndrewSong1122]

I've seen people mention downloading hundreds of profiles within a few days. How do they do this? Can I download all my followed profiles with a config or command line option?

[Soeroah]

It's harder now twitter has a daily rate limit, so I dunno about downloading hundreds of profiles entirely, but I run about 250 profiles each day for anything new since last time I scraped, usually comes out to about 50-60 hits.

What I personally do is I have a notepad file with the command to run gallery-dl against each account, and I just copy-paste them all into a command prompt. If you do that, it'll run each command sequentially as the previous one finishes, so you can run hundreds of commands with just one copy-paste.

[mikf]

Use an -i/--input-file that contains all URLs you want to download from.

gallery-dl -i twitter_profile_urls.txt

To download from your followed profiles, use https://x.com/YOURUSERNAME/following as input URL for gallery-dl. You can even write their URLs to a file and then use it as --input-file.

gallery-dl -g https://x.com/YOURUSERNAME/following > followed_users.txt
gallery-dl -i followed_users.txt