Skip to content

Home

Jump to bottom
Amirhossein Douzandeh Zenoozi edited this page Aug 20, 2023 · 1 revision

How to collect data from different agencies

If you really want to collect your own dataset, you just need to run these commands:

  • from farsNews: python fars_archive.py
  • from mehrNews: python mehr_archive.py
  • from khabarOnline: python khabar_online_archive.py
  • from ISNA: python isna_archive.py

all of these scripts will use archive.db inside the volume folder. If this file does not exist it will create automatically. After this step, if you want to have access to CSV format you just need to run sqlite_to_csv.py. It will create a CSV file with the same name from the input path:

  • python sqlite_to_csv.py --file PATH_TO_DB_FILE

You Can Easily Access The Dataset in Kaggle.

Clone this wiki locally