I'm a second-year Master's student working at the intersection of HPC and Machine Learning. My research focuses on distributed training of large models and low-precision training. Also, I am in charge of the maintenance of Pre-training Library for LLMs and conducting experiments on training LLMs.
I am a core contributor of Swallow Project which is a Japanese LLM development initiative.
- Website: https://okoge-kaz.github.io/
- Google Scholar: https://scholar.google.co.jp/citations?user=jHXLs2wAAAAJ
- LinkedIn: https://www.linkedin.com/in/kazuki-fujii