Speech and Natural Language Processing

This page shows some of the open source projects, toolkits and websites which are typically useful for researches or applications in speech and language processing.

Other lists for SNLP: [List1-Github-SNLP] [List2-Zhihu-SNLP] [List3-Github-Speech]

Jump to: [Speech] [NLP] [Machine Learning and Neural Net] [Research] [Courses]

---

Speech related:

1. CMUSphinx [link]
   OPEN SOURCE SPEECH RECOGNITION TOOLKIT
   
2. Festival [link] [documentation]
   Speech Synthesis System by CSTR
   
3. Speech-Corpus-Collection [link]
   
4. Kaldi ASR [link]
   
5. Praat [link]
   
6. LibriSpeech ASR corpus [link]
   Large-scale (1000 hours) corpus of read English speech
   
7. Common voice [Github] [website]
   Common Voice is Mozilla's initiative to help teach machines how real people speak.
   https://github.com/mozilla/voice-web/tree/master/server/data/zh-HK
8. TED-LIUM Release 3 [link]
   452 hours of audio
   
9. VoxForge [link]
   VoxForge was set up to collect transcribed speech for use in Open Source Speech Recognition Engines ("SRE"s) such as such as ISIP, HTK, Julius and Sphinx.
   
10. Tatoeba [link]
    Tatoeba is a collection of sentences and translations.
    
11. EMIME Project [link]
    
12. CMU_ARCTIC speech synthesis databases [link]
    
13. The World English Bible [link]
    
14. Nancy Corpus [link]
    
15. Google uis-rnn [Github] [paper]
    This is the library for the Unbounded Interleaved-State Recurrent Neural Network (UIS-RNN) algorithm, corresponding to the paper Fully Supervised Speaker Diarization.
16. A simple interface for the CMU pronouncing dictionary [link]
    
17. E-Guide dog [link]
    
18. PyTorch implementation of GAN-based text-to-speech synthesis and voice conversion (VC) [link]
    
19. Something useful for speech and natural language processing [link]
    Something useful for speech and natural language processing
    
20. Saarbruecken Voice Database [link]
    
21. A British National Corpus Spoken Audio Sampler [link]
    This site presents a selection of audio files from the spoken part of the British National Corpus, digitized from the analogue audio cassette tapes deposited at the British Library Sound Archive, together with associated transcription and annotation files created during the Mining a Year of Speech project.
    
22. pronouncingpy [link]
    A simple interface for the CMU pronouncing dictionary
    
23. Sound & MIDI Software For Linux [link]
    
24. Linguistic Variation in Chinese Speech Communities 泛華語地區漢語共時語料庫 [link]
    
25. Translatotron [link]
    Translatotron: An End-to-End Speech-to-Speech Translation Model
    
26. Pyworld [link]
    A Python wrapper for the high-quality vocoder "World"
    
27. NAME [link]
    INFO
    

NLP related:

1. BBC news corpus [link]
   
2. GEO query database [link]
   
3. FreeBase for QA [link]
   
4. Google Bert [link]
   TensorFlow code and pre-trained models for BERT https://arxiv.org/abs/1810.04805
5. Google Dialogflow(previously api.ai) [link]
   
6. DouBan DuShu [link]
   DouBan DuShu is a Chinese website where users can share their reviews about various kinds of books.
   
7. Chinese-Forum-Corpus [link]
   Chinese-Forum-Corpus is a corpus of informal Chinese text
   
8. CLAMP [link]
   Clinical Language Annotation, Modeling, and Processing Toolkit
   
9. Bytecup2018 [link]
   Bytecup Dataset
   
10. Facebook fastText [link]
    fastText is a library for efficient learning of word representations and sentence classification.
    
11. 開放中文轉換（Pure Python） [link]
    Open Chinese convert (OpenCC) in pure Python.
    
12. pkuseg-python [link]
    pkuseg 是由北京大学语言计算与机器学习研究组研制推出的一套全新的中文分词工具包。
    
13. OpenAI GPT-2 [link]
    Code for the paper "Language Models are Unsupervised Multitask Learners"
    
14. XLNET [link]
    XLNet: Generalized Autoregressive Pretraining for Language Understanding
    

Machine Learning / Neural Network related:

1. An MIT Press book by Ian Goodfellow and Yoshua Bengio and Aaron Courville [link]
   
2. Deepmind trfl [link]
   
3. Dopamine is a research framework for fast prototyping of reinforcement learning algorithms [link]
   
4. Neural Networks and Deep Learning, a free online book [link]
   
5. TensorSpace.js [link]
   A neural network 3D visualization framework built by TensorFlow.js, Three.js and Tween.js
6. Deep Reinforcement Learning for Keras [link]
   keras-rl implements some state-of-the art deep reinforcement learning algorithms in Python and seamlessly integrates with the deep learning library Keras.
   
7. 《Attention is All You Need》中的Attention机制的实现 [link]
   
8. pytorch-beginner [link]
   Toy code for pytorch beginner
   

Research paper:

1. One Model To Learn Them All [link]
   #2017 #MultiTasking
   
2. Attention Is All You Need [link]
   #2017 #NeuralNetwork #Attention
   
3. Low-Resource Speech-to-Text Translation [link]
   
4. speech-to-speech translation [link]
   
5. Psychlab: A Psychology Laboratory for Deep Reinforcement Learning Agents [link]
   
6. Multimodal Machine Translation with Reinforcement Learning [link]
   
7. Exploiting Linguistic Resources for Neural Machine Translation Using Multi-task Learning [link]
   
8. Self-managed Speech Therapy [link]
   #2018 #SpeechTherapy
   
9. Voice-based determination of physical and emotional characteristics of users [link]
   Systems, methods, and computer-readable media are disclosed for voice-based determination of physical and emotional characteristics of users. Example methods may include determining first voice data, wherein the first voice data is generated by a user, determining a first real-time user status of the user using the first voice data, generating a first data tag indicative of the first real-time user status, determining first audio content for presentation at a speaker device using the first data tag and the first voice data, and causing presentation of the first audio content via a speaker of the speaker device.
   
10. 香港成人粵語口語語料庫 [link]
    INFO
    
11. 粵語研究新資源：《香港二十世紀中期粵語語料庫》 [link]
    mentioned (1) 香港兒童粵語語料庫（Hong Kong Cantonese Child Language Corpus - CANCORP）（Lee and Wong 1998）(2) 香港雙語兒童語料庫（Yip and Matthews 2007）(3) 香港粵語語料庫（Hong Kong University Cantonese Corpus）（Wong 2006）(4) The Hong Kong Cantonese Adult Corpus（Leung and Law 2001）
    
12. Large-Scale Study of Curiosity-Driven Learning [link]
    Curiosity-Driven RL
    
13. SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient [link]
    #2017
    
14. Recent Trends in Deep Learning Based Natural Language Processing [link]
    #2018
    
15. SEQUENCE-TO-SEQUENCE ASR OPTIMIZATION VIA REINFORCEMENT LEARNING [link]
    
16. Listen, Attend and Spell [link]
    Listen, Attend and Spell (LAS), a neural network that learns to transcribe speech utterances to characters.
    
17. State-of-the-Art Speech Recognition with Sequence-to-Sequence Models [link]
    Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural network. On a 12, 500 hour voice search task, we find that the proposed changes improve the WER from 9.2% to 5.6%, while the best conventional system achieves 6.7%; on a dictation task our model achieves a WER of 4.1% compared to 5% for the conventional system.
    
18. PyText [link]
    Open-sourcing PyText for faster NLP development
    
19. NAME [link]
    INFO
    

Courses

1. Oxford Deep NLP 2017 course [link]
   
2. Deepmind UCL Deep RL [link]
   
3. Steps by steps - learn Computer Science and Artificial Intelligence [link]
   
4. AI For Everyone - Coursera [link]
   
5. Neural Networks and Deep Learning [link]
   Neural networks and deep learning currently provide the best solutions to many problems in image recognition, speech recognition, and natural language processing. This book will teach you many of the core concepts behind neural networks and deep learning.
   
6. Introduction to Digital Speech Processing 數位語音處理概論 - 李琳山教授 [link]
   本課程專為大學部同學所開授。所需要的最主要基礎能力是數學模型(機率、線性代數)及軟體程式，所有難題由數學模型分析，並由程式求解；其中大部份核心觀念均與機器學習(Machine Learning)
   
7. Merlin:中文统计参数语音合成实战 [link]
   本文目标是详细解释如何基于开源Merlin项目搭建中文统计参数语音合成系统，但笔者目前尚未实现中文语音合成，本文记录了笔者的进展并且会持续更新直到实现中文语音合成为止。
   
8. Reinforcement Learning: An Introduction [pdf-link] [main-link]
   Second Edition, in progress - MIT Press, Cambridge, MA, 2017
   
9. NAME [link]
   INFO