Followers Scraper API on AWS Serverless Lambda

Supports YouTube, Twitter and Instagram Followers

Usage

To use this repo locally you need to have the Serverless framework installed.

$ npm install serverless -g

Clone this repo and install the NPM packages.

$ git clone https://github.com/jeanrauwers/followers-scraper-serverless
$ npm install

Run a single API on local.

$ npm run dev

You need to have your own aws-cli with your credentials configured and than you can run $npm run deploy to deploy the lambda to AWS.

You can create your creditials on IAM panel, remember to provide the right access to your user so you can write to S3 Buckets.

The scraper lambda works based on CloudWatch schedule that you can define at your AWS console as a cron job.

Data is returned on /api/likes end point on the following format :

{
    "data": [
        {
        "twitter": "307",
        "instagram": "3895",
        "youtube": "389",
        "date": "11/02/2020"
        },
        {
        "twitter": "308",
        "instagram": "3896",
        "youtube": "389",
        "date": "11/02/2020"
        },
        {
        "twitter": "308",
        "instagram": "3896",
        "youtube": "389",
        "date": "10/02/2020"
        }
    ]
}

If you need to force to update the data before the cron job you can hit /api/likes/update with a get request and it will trigger the update and return the latest scrape data

Enjoy and have fun!