Support for torch.nn.Transformer Class?

[niticon]

I was hoping to compare performance of Transformer models and non-Transformer models. I'm essentially trying to reproduce BERT which is possible according to the PyTorch documentation. Or am I better off just adding the model class to the neural_nets.py library?

[TParcollet]

Hi, sorry for the late reply, we are very very busy with SpeechBrain and PyTorch-Kaldi won't be maintained anymore very soon. You can easily wrap the pytorch transformers to a model in neural_nets.py.