v1.0.1

#16

v1.0.0

1. dist checkpoint format
2. fsdp to hf format checkpoint converter
3. documentation (README)

v0.3

#10

V0.2

What's Changed

• Support Llama-3 by @okoge-kaz in #3
• Support Phi-3, Yi-1.5, Codestral by @okoge-kaz in #4

Full Changelog: v0.1...v0.2

v0.1

Overview

Supported Models are below.

• Llama-2
  • 7B and 13B work, but the 70B model has some problems with saving checkpoints.
• Mistral
• Phi-3