data_analysis

An Enterprise Practice Project during undergraduate studying, grade-3.

• Main technology stack：Hadoop, Spark, e-charts and Flask.
• Main contents: -- use web crawlers to crawl relevant data. -- use handoop store data, and use spark analysis this data. -- Finanlly, we will use Flask to create a website for visualizing data analysis results.

Completed work：

• spider_processing: a web crawlers.
• apsrk_datamodiy: to analysis this data which uses spark.