Skip to content

Latest commit

 

History

History
6 lines (6 loc) · 382 Bytes

File metadata and controls

6 lines (6 loc) · 382 Bytes

To execulte the language model, enter

python3 main.py  

You can then enter the sentence you wanna test, and get the perplexities. If you want to get perplexities of training and validation instead, then turn the value write_perplexities in line 3 of the code to true.
NOTE: text_splitter.py contains code for splitting the corpus into training/testing/validation.