Search Engine and Web Crawler in Python

文系が頑張って作ったpython検索エンジン

• Implement a web crawler
• japanese morphological analysis using janome
• Implement search engine
• Store in MongoDB
• Web frontend using Flask

Requirements

• Python 3.5

Setup

1. Clone repository

   $ git clone [email protected]:wimpykid719/pythonengine.git
   

2. Install python packages

   $ cd SearchEngine
   $ pip install -r requirements.txt -c constraints.txt
   

3. MongoDB settings

4. Run

   $ python manage.py crawler # build a index
   $ python manage.py webpage # access to http://127.0.0.1:9000
   

参考にさせてもらいとても助かりました。 Tech Blog(Japanese).