Skip to content

A parliament member information scraper. Scrapes Member details, Parties and Constituencies.

Notifications You must be signed in to change notification settings

fmacpro/parliament-data-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Parliamentary Data Scraper

Scrapes MPs details, Constituencies, Parties, Government Roles & Groups into a useful json format.

Currently covers:

  • House of Commons (United Kingdom Parliament)
  • Scottish Parliament

Usage Example

Install the package using npm install parliament-data-scraper --save then use it:

const scraper = require('parliament-data-scraper');

(async () => {
    await scraper.scrapeAllParliamentData(__dirname + '/data/');
})();

this will create the following files in the data/ directory in the project root

uk-parliament/commons/mps-details.json
uk-parliament/commons/mps.json
uk-parliament/commons/parties.json
uk-parliament/commons/constituencies.json

scottish-parliament/msps-details.json
scottish-parliament/msps.json
scottish-parliament/parties.json
scottish-parliament/constituencies.json
scottish-parliament/government-roles.json
scottish-parliament/cross-party-groups.json

Todo List

  • Add House of Lords
  • Add Northern Ireland Assembly
  • Add Welsh Assembly
  • Extend scope of data
  • Add others

Contributions

  • Contributions welcome just follow the general structure of the project and open a pull request

About

A parliament member information scraper. Scrapes Member details, Parties and Constituencies.

Resources

Stars

Watchers

Forks

Packages

No packages published