update T5

NathanGodey · Nov 8, 2024 · daa44a5 · daa44a5
1 parent 8296a9a
commit daa44a5
Show file tree

Hide file tree

Showing 2 changed files with 3 additions and 3 deletions.
diff --git a/imgs/course3/T5_lm.svg b/imgs/course3/T5_lm.svg
diff --git a/markdown/course3_lm.md b/markdown/course3_lm.md
@@ -521,10 +521,10 @@ $$
 - A useful evaluation metric: ***Perplexity***
 - Defined as:
 $$
-ppl(T_{\theta}; w_1...w_n) = \sqrt[n]{\frac{1}{P_{\theta}(w_1...w_n)}}
+ppl(T_{\theta}; w_1...w_n) = \exp \left( -\frac{1}{n}\sum_{t=1}^{n}\log P_{\theta}(w_t | w_{<t}) \right)
 $$
 
-- Other metrics: accuracy, f1-score, ...
+- Other metrics: accuracy, MAUVE, ...
 
 ---
 ### Zero-shot evaluation