Skip to content

Latest commit

 

History

History
10 lines (10 loc) · 500 Bytes

README.md

File metadata and controls

10 lines (10 loc) · 500 Bytes

data_analysis

An Enterprise Practice Project during undergraduate studying, grade-3.

  • Main technology stack:Hadoop, Spark, e-charts and Flask.
  • Main contents: -- use web crawlers to crawl relevant data. -- use handoop store data, and use spark analysis this data. -- Finanlly, we will use Flask to create a website for visualizing data analysis results.

Completed work:

  • spider_processing: a web crawlers.
  • apsrk_datamodiy: to analysis this data which uses spark.