We provide premium proxy services and web scraping solutions, trusted by developers worldwide. Our GitHub organisation offers tools, SDKs, and tutorials. Explore our repositories' collections:
Open-source frameworks designed to facilitate your web scraping projecs.
- OxyParser: Oxy®Parser simplifies HTML parsing by leveraging LLMs and Pydantic models. Define your HTML structure with Pydantic, and let OxyParser automatically transform HTML into structured data models.
- OxyMouse: Generates realistic mouse movement paths using advanced algorithms.
- Web Scraper API Scheduler: Quickly start and test Scraper API payloads with basic programming knowledge.
SDKs and code samples to help you integrate Oxylabs' solutions into your projects.
- oxylabs-sdk-go: Go SDK for Oxylabs' Scraper API.
- oxylabs-sdk-python: Python SDK for working with Oxylabs' API.
- product-integrations: Oxylabs product integration tutorials.
- proxy-integrations: Proxy integration tutorials.
- selenium-proxy-integration-python: Residential Proxies' integration with Selenium in Python.
- selenium-proxy-integration-java: Residential Proxies' integration with Selenium using Java.
- puppeteer-proxy-integration-js: Proxies' integration with Puppeteer using JavaScript.
- playwright-proxy-integration-js: Residential and Datacenter proxies' integration with Playwright using JavaScript.
- mechanicalsoup-proxy-integration: Python tutorial for integrating Residential Proxies with MechanicalSoup.
- aiohttp-proxy-integration: Python tutorial for integrating Residential Proxies with AIOHTTP.
- proxy-integration-with-parsehub: Proxies' integration with ParseHub.
- integration-python-requests: Residential and Datacenter Proxies' integration with Python Requests.
- integration-with-node-fetch: Node-Fetch integration with proxies.
Tutorials and guides to help you get started with web scraping (organized by language).
- web-scraping-selenium-python: Web Scraping with Python Selenium for beginners.
- seo-monitoring: SEO Monitoring System with Python, Celery, and a SERP Scraper API (now a part of Web Scraper API).
- scrapy-web-scraping: Tutorial for web scraping with Scrapy.
- python-cache-tutorial: Tutorial to caching web scraping scripts in Python.
- playwright-web-scraping: Web scraping using Playwright headless browser.
- how-to-make-web-scraping-faster: Tips to make web scraping faster with Python.
- automate-competitors-benchmark-analysis: Tutorial to automating competitors’ & benchmark analysis.
- asynchronous-web-scraping-python: A comparison of asynchronous and synchronous web scraping methods.
- Python-Web-Scraping-Tutorial: Guide to Python web scraping.
- oxycon2021-active-fingerprinting-pyppeteer: Tutorial for active fingerprinting with Pyppeteer.
- best-buy-price-tracker: Scalable Best Buy price tracker tutorial.
- walmart-price-tracker: Walmart price tracker tutorial.
- puppeteer-tutorial: Web scraping with Puppeteer tutorial.
- crawlee-web-scraping-tutorial: Web scraping using Crawlee tutorial.
- webscraping-with-ruby: Web scraping with Ruby.
- web-scraping-r: Web scraping with R.
- web-scraping-php: Web scraping with PHP.
- guzzle-proxy: Proxies' setup in Guzzle for PHP.
- web-scraping-powershell: Tutorial on using PowerShell and PowerHTML for web scraping.
Solutions and tools for scraping Google pages.
- google-scraper: Scrape Google data with Python.
- google-images-scraper: Scrape Google images in real time.
- google-trends-scraper: Scrape Google Trends data and make a result comparison using Python.
- google-flights-scraper: Scrape flight data from Google Flights and analyze flight prices with Python.
- google-news-scraper: Use Google News API to get the latest global news.
- google-play-scraper: Scrape Google Play and collect public details about applications, and more.
- google-scholar-scraper: Extract titles, authors, and citations from Google Scholar using Python.
- google-jobs-scraper: Build your own Google Jobs scraper with Python.
Specialized scrapers for popular e-commerce platforms.
- quick-start-guide: A tutorial on using Oxylabs' Web Scraper API for E-Commerce targets.
- amazon-asin-scraper: Extract product ASINs from Amazon.
- bypass-amazon-captcha: Bypass CAPTCHA when extracting public data from Amazon.
- amazon-review-scraper: Extract Amazonreview data.
- ebay-scraper: Extract product details from eBay.
- alibaba-scraper: Extract data from Alibaba for e-commerce analysis.
- walmart-scraper: Scrape product information from Walmart.
- wayfair-scraper: Extract titles, prices, reviews Wayfair.
- zara-scraper: Extract data from Zara's online store.
- redbubble-scraper: Extract data from the Redbubble platform.
- aliexpress-scraper: Extract prices, product details, and ratings.
- priceline-scraper: Get Priceline data.
- shein-scraper: Extract product data from Shein.
- macys-scraper: Extract data from the Macy's ecommerce platform.
- opensea-scraper: Get NFT's data.
- azada-scraper: Get product data from the Lazada e-commerce platform.
- etsy-scraper: Extract data from Etsy.
- adidas-scraper: Extract data from Adidas' online platforms.
- 1688-scraper: Extract data from the 1688 e-commerce platform.
- xbox-scraper: Extract game data from Xbox.
- biglots-scraper: Get data from Biglots's retailers' websites.
- gamestop-scraper: Extract data from Gamestop's site.
- worten-scraper: Extract product data from Worten.
- digikey-scraper: Extract electronic component data from the Digikey.
- bunnings-scraper: Extract data from Bunnings' website.
Specialized scrapers for various websites.
- indeed-scraper: Extract job postings from Indeed.
- redfin-scraper: Extract real estate data from Redfin.
- expedia-scraper: Extract data from the Expedia website.
- trip-scraper: Extract travel data from various sources globally.
- trivago-scraper: Get real-time data from Trivago.
- craigslist-scraper: Gather public Craigslist data.
Guides and tools for parsing and processing scraped data.
- parse-html-pyquery: Tutorial for parsing HTML with PyQuery in Python.
- beautiful-soup-parsing-tutorial: Tutorial for using Beautiful Soup to parse data in Python.
- pandas-read-html: Tutorial for reading HTML tables with pandas.
- date-parser-tutorial: Tutorial for parsing dates in Python.
- parse-xml-in-python: Tutorial for parsing XML data in Python.
- price-parsing-tutorial: Tutorial for parsing prices in Python.
- python-parse-json: Tutorial for parsing JSON data with Python.
- custom-parser-instructions: Tutorial for writing parsing instructions with Oxylabs' Custom Parser.
Guides and tools for setting up and using proxies.
- proxy-manager-app: Tutorial for proxy manager app.
- proxy-chrome-extension: Tutorial for Proxy Chrome extension.
- curl-with-proxy: A tutorial on using cURL command with proxies.
- http-headers-with-curl: Guide to sending and receiving HTTP headers using cURL.
- rotating-proxies-javascript: Tutorial for rotating proxies with JavaScript.
- rotating-proxies-python: Tutorial for rotating proxies with Python.
- wget-proxy: Tutorial for using wget command with proxies.
- tamilyogi-proxy: Tutorial for TamilYogi proxies.
- datacenter-proxies: Tutorial for Oxylabs' Datacenter proxies.
We welcome contributions from the community. If you would like to contribute to our projects, please check out our Contribution Guidelines for more information on how to get involved.
Additionally, feel free to join our Discord server to connect with other developers, share ideas, and stay updated on the latest developments.
If you have questions or need support, reach out to us at support@oxylabs.io, or through live chat, accessible via Oxylabs Dashboard, or join our Discord community. For enterprise-related inquiries, contact your dedicated account manager.