Skip to content

Ongoing research training transformer language models at scale, including: BERT & GPT-2

License

Notifications You must be signed in to change notification settings

ElementAI/Megatron-LM

Error
Looks like something went wrong!

About

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 91.2%
  • C++ 6.0%
  • Cuda 2.4%
  • C 0.2%
  • HTML 0.2%
  • Makefile 0.0%