Repositories list

• Gerapy

  Public
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

  vuejsdashboarddistributed+ 8webspiderdockerdjangospidervuescrapyscrapyd+ 1

  Python

  •

  MIT License

  •644•3.4k•64•7•Updated Oct 29, 2024Oct 29, 2024

• GerapyAutoExtractor

  Public
  Auto Extractor Module

  Python

  •

  Apache License 2.0

  •79•320•17•0•Updated Aug 19, 2024Aug 19, 2024

• GerapyRabbitMQ

  Public
  Distribution Support for Scrapy & Gerapy using RabbitMQ

  Python

  •1•9•2•0•Updated Nov 27, 2023Nov 27, 2023

• GerapyItemPipeline

  Public
  Item Pipeline Components for Gerapy & Scrapy

  Python

  •2•1•0•1•Updated Sep 20, 2023Sep 20, 2023

• GerapyPlaywright

  Public
  Downloader Middleware to support Playwright in Scrapy & Gerapy

  Python

  •21•106•13•0•Updated Mar 6, 2022Mar 6, 2022

• GerapyPyppeteer

  Public
  Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

  Python

  •37•137•7•0•Updated Dec 27, 2021Dec 27, 2021

• GerapyPrometheusExporter

  Public
  Gerapy Prometheus Exporter

  Python

  •2•4•1•0•Updated Mar 16, 2021Mar 16, 2021

• GerapyRedis

  Public
  Distribution Support for Scrapy & Gerapy using Redis

  Python

  •1•8•0•0•Updated Mar 16, 2021Mar 16, 2021

• GerapySelenium

  Public
  Downloader Middleware to support Selenium in Scrapy & Gerapy

  Python

  •3•31•4•0•Updated Sep 13, 2020Sep 13, 2020

• Acinonyx

  Public
  A package which can simplify your multiprocessing implementation

  Python

  •0•4•0•0•Updated Jul 27, 2020Jul 27, 2020

• GerapyProxy

  Public
  A package for supporting proxy in Scrapy & Gerapy

  Python

  •4•10•0•0•Updated Jul 15, 2020Jul 15, 2020

• Docs

  Public
  Document of Gerapy

  HTML

  •2•5•1•0•Updated Jul 6, 2020Jul 6, 2020