Skip to content

kevupton/phantom-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

87 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PHANTOM CRAWLER SERVER

Easy web-crawling using HTTP API server.

INSTALL

npm i -g phantom-crawler-server

USAGE

Execute command to run:

phantom-crawler

GET

Get a specific page

METHOD: GET
URL: /get/:url
RESPONSE:
{
  status_code: 200,
  data: "<html></html>"
}

DOWNLOAD

Download the active page

METHOD: GET
URL: /download
RESPONSE: content.html

DISPLAY

Display the active page

METHOD: GET
URL: /display
RESPONSE: <html></html>

CLICK

Click on something on the page

METHOD: POST
URL: /click
BODY: 
{
  query: "#someQuerySelector"
}

FILL

Fill out some form inputs

METHOD: POST
URL: /fill
BODY: 
{
  inputs: {
    #someQuerySelector": "value"
    #someQuerySelector2": "value2"
  }
}

About

PhantomJS Web Server Crawler

Resources

Stars

Watchers

Forks

Packages

No packages published