LING-131a Final Project: Text Normalization

Project Introduction

Presentation: Google Slides

Project write-up: Google Docs

Project Structure

.
├── BBCNews                 # Scrapy spider for scraping BBCNews(unused)
├── Bloomberg               # Scrapy spider for scraping Bloomberg
├── decision_tree           # word2vec, decision tree training and analysis code
├── out                     # output of normalized text
├── text_normalization      # regular expression and text normalization code
└── README.md

Usage Instructions

Read README.md in each folder for instruction on how to run the code

• ./decision_tree/README.md
• ./text_normalization/README.md