ASR E2E Toolkit

Encoder output

• Input: inputs, input_lengths
• Output: outputs, output_lengths

Decoder:

• Input: targets, target_lengths, encoder_outputs (optional)

• Output: decoder_outputs

• Nếu có encoder_outputs thì mới sử dụng attention

Với mỗi lớp encoder và decoder thì đều phải có tham số output_dim

References

• https://github.com/sooftware/conformer

Variable

set HYDRA_FULL_ERROR=1

Run

• python main.py -cp conf -cn configs

Training Template

• Conformer-Transformer-AED Vivos: https://colab.research.google.com/drive/10dpTTy5huj7SjLst2Jj_Iff2aXLYJoBS?usp=sharing
• Conformer-Transformer-AED LibriSpeech: https://www.kaggle.com/code/tuannguyenvananh/conformer-transformer-aed-librispeech

Install package

conda create -n train_env -c pytorch-nightly -c nvidia -c pytorch -c conda-forge python=3.7 pytorch torchaudio cudatoolkit pandas numpy