An Enterprise Practice Project during undergraduate studying, grade-3.
- Main technology stack:Hadoop, Spark, e-charts and Flask.
- Main contents: -- use web crawlers to crawl relevant data. -- use handoop store data, and use spark analysis this data. -- Finanlly, we will use Flask to create a website for visualizing data analysis results.
- spider_processing: a web crawlers.
- apsrk_datamodiy: to analysis this data which uses spark.