We invite you to explore our blog for more details.
- Install Python 3 on your computer
- Run
pip install -r requirements.txt
- Create an account at Crawlbase and log in.
- Upon registration, you will automatically receive 5,000 free requests.
- Go to your account dashboard and copy your Normal Requests Token.
- Replace every instance of
<Crawlbase Normal requests token>in the code with your actual token.
- Sign up for an account at Perplexity.ai.
- Copy your OpenAI-compatible API key from your account settings.
- Replace every instance of
<perplexity.ai API KEY>in the code with your actual key.
🛡 Disclaimer This repository is for educational purposes only. Please make sure you comply with the Terms of Service of any website you scrape. Use this responsibly and only where permitted.
Copyright 2025 Crawlbase