Skip to content

An encoder-decoder transformer implemented from scratch for English-Portuguese translation. For educational purposes only.

Notifications You must be signed in to change notification settings

lucascogrossi/transformer-from-scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Transformer from Scratch

An encoder-decoder transformer model implemented from scratch, based on the paper "Attention Is All You Need". The goal is to understand the core components of the Transformer architecture by building it step by step.

The model was trained on parallel English-Portuguese text to perform machine translation using the OPUS Books dataset.

transformer

About

An encoder-decoder transformer implemented from scratch for English-Portuguese translation. For educational purposes only.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages