Skip to content

Latest commit

 

History

History
17 lines (15 loc) · 996 Bytes

README.md

File metadata and controls

17 lines (15 loc) · 996 Bytes

Web Scraping with Splinter, BS4 and WebDrvier Manager- Mission to Mars


Web application that scrapes various websites for data related to the Mission to Mars and present the information in a HTML Page

The following were performed to get the results:

  • Create Jupyter Notebook for initial scraping and analysis
  • Identified the structure of the sites and used Beautiful Soup to find the required HTML element
  • Scraped Latest News Title and Paragraph text
  • Scraped Images
  • Scraped Mars Facts and used Pandas to convert data to HTML table string
  • Setup MongoDB with Flask to create new HTML page to display all the information
  • Converted whole Jupyter Notebook into Python Script

Site Demo