Skip to content
@apify

Apify

Put the web to work.
README.md

Apify Banner

Apify is the largest marketplace of tools for AI. Thousands of ready-to-run tools get web data, automate tasks on the web, and give your agents real-time context. We call them Actors.

discord X/Twitter youtube linkedin

Learn About Apify 🧑‍🎓

  • Find an Actor for your web scraping or automation project on Apify Store.
  • Build your own Actors, publish them to Apify Store, and earn passive income when others use them.
  • Connect your AI agents to the web with the Apify MCP server.
  • Build reliable crawlers with Crawlee, Apify's open-source library for JavaScript and Python.
  • Learn web scraping and automation with the free courses at Apify Academy.
  • Publish your web scrapers as paid Actors on the Apify platform, attract people who need these solutions, and get regular passive income.
  • Watch livestreams and tutorials on the Apify YouTube channel.
  • Read guides and deep dives on Apify Blog and Crawlee Blog.

We are hiring! 🕸️

Check out the open positions at Apify and help us make the web more programmable.

Pinned Loading

  1. crawlee crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…

    TypeScript 25.9k 1.7k

  2. impit impit Public

    impit | rust library for browser impersonation

    Rust 595 46

  3. crawlee-python crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…

    Python 9.6k 811

  4. apify-mcp-server apify-mcp-server Public

    The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and aut…

    TypeScript 8.9k 286

  5. mcpc mcpc Public

    A universal CLI client for MCP. mcpc supports persistent sessions, stdio/HTTP, OAuth 2.1, tasks, JSON output for code mode, proxy for AI sandboxes, x402, and more.

    TypeScript 936 94

  6. proxy-chain proxy-chain Public

    TypeScript/Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chaining.

    TypeScript 1k 166

Repositories

Showing 10 of 263 repositories
  • apify-mcp-server Public

    The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.

    apify/apify-mcp-server's past year of commit activity
    TypeScript 8,888 MIT 286 167 (1 issue needs help) 34 Updated Sep 29, 2026
  • apify-client-python Public

    Apify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule and monitor runs, and access the full Apify platform API. Sync and async interfaces with automatic retries and pagination.

    apify/apify-client-python's past year of commit activity
    Python 99 Apache-2.0 18 4 2 Updated Sep 29, 2026
  • apify-cli Public

    Apify command-line interface helps you create, develop, build and run Apify Actors, and manage the Apify cloud platform.

    apify/apify-cli's past year of commit activity
    TypeScript 253 Apache-2.0 65 113 52 Updated Sep 28, 2026
  • actor-llmstxt-generator Public

    The /llms.txt Generator Actor 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

    apify/actor-llmstxt-generator's past year of commit activity
    Python 32 Apache-2.0 8 0 0 Updated Sep 28, 2026
  • proxy-chain Public

    TypeScript/Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chaining.

    apify/proxy-chain's past year of commit activity
    TypeScript 1,041 Apache-2.0 166 19 (2 issues need help) 5 Updated Sep 28, 2026
  • apify-docs Public

    This project is the home of Apify's documentation.

    apify/apify-docs's past year of commit activity
    JavaScript 79 Apache-2.0 235 136 (1 issue needs help) 71 Updated Sep 28, 2026
  • apify-sdk-js Public

    Apify SDK monorepo

    apify/apify-sdk-js's past year of commit activity
    MDX 185 Apache-2.0 65 26 5 Updated Sep 28, 2026
  • impit Public

    impit | rust library for browser impersonation

    apify/impit's past year of commit activity
    Rust 595 Apache-2.0 46 7 3 Updated Sep 28, 2026
  • crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

    apify/crawlee-python's past year of commit activity
    Python 9,562 Apache-2.0 811 86 12 Updated Sep 28, 2026
  • hubspot-data-import-actor Public

    This Actor maps your Apify dataset items into HubSpot company fields and performs imports

    apify/hubspot-data-import-actor's past year of commit activity
    TypeScript 0 0 1 2 Updated Sep 27, 2026
View all repositories