Skip to content

Commit ce08504

Browse files
committed
update log: 2022-07-09
1 parent ac1659b commit ce08504

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed

logs/2022-07-09.md

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
2+
# CPM-Live Training Log (July, 9)
3+
4+
Time: July, 9 2022 16:00
5+
6+
Recorder: @jayzzhou-thu
7+
8+
## Loss
9+
- Begin: 2.55
10+
- End: 2.60
11+
12+
## Completed Data
13+
- $\approx$ 518.54GB
14+
15+
## Average Grad Norm
16+
- 0.92
17+
18+
## Progress
19+
- 55.68%
20+
21+
## Comment
22+
23+
The change in the training loss is currently in line with our expectations. A new model [NLLB](https://research.facebook.com/publications/no-language-left-behind/) is recently released by Meta. The model is multi-lingual and could translate between 200 languages. It is so cool and we wish CPM-Live could support more languages in the future.

0 commit comments

Comments
 (0)