Skip to content

Latest commit

 

History

History
55 lines (46 loc) · 4.42 KB

results.md

File metadata and controls

55 lines (46 loc) · 4.42 KB

Word-level accuracy for each language and micro averaged across languages (main evaluation metric)

Track 1

Submission arp ddo git lez ntu nyb usp AVG Partial submission?
Tü-CL_2 78.79 80.94 21.09 78.78 81.04 85.05 73.39 71.30
Tü-CL_1 77.90 80.96 4.69 78.10 80.20 85.34 68.86 68.01
COATES_1 55.56 74.45 6.51 65.69 70.63 77.01 66.99 59.55
BASELINE 71.14 73.41 16.93 49.66 42.01 5.96 72.06 47.31
TeamSiggyMorph_1 - 52.46 - 22.91 41.82 59.22 57.26 46.73 X
TeamSiggyMorph_2 - 52.46 - 22.91 41.82 59.22 57.26 46.73 X

Track 2

Submission arp ddo git lez ntu nyb usp AVG Partial submission?
Tü-CL_2 85.80 85.79 26.56 83.41 87.92 87.98 78.46 76.56
Tü-CL_1 85.12 85.68 13.80 85.44 87.83 85.90 77.21 74.43
SigMoreFun_2 82.92 80.07 31.25 77.77 78.72 85.53 77.51 73.39
LISNTeam_1 - 84.85 28.39 83.41 88.85 - 76.30 72.36 X
SigMoreFun_1 85.87 73.77 27.86 74.15 82.99 80.61 73.47 71.25
SigMoreFun_4 80.56 82.79 20.57 63.77 77.97 82.59 75.72 69.14
LISNTeam_2 - - 31.51 82.73 89.31 - - 67.85 X
TeamSiggyMorph_2 0.03 79.28 26.56 81.72 87.73 76.25 75.84 61.06
BASELINE 85.44 75.71 16.41 34.54 41.08 84.30 76.55 59.14
SigMoreFun_3 73.27 62.37 4.17 38.60 55.11 69.25 70.85 53.38

Morpheme-level accuracy for each language and micro averaged across languages

Track 1

Submission arp ddo git lez ntu nyb usp AVG Partial submission?
Tü-CL_2 78.47 73.95 11.72 62.10 56.32 85.24 70.05 62.55
Tü-CL_1 76.56 70.29 9.26 62.03 56.38 86.74 60.42 60.24
TeamSiggyMorph_1 - 53.19 - 28.13 31.86 66.25 59.73 47.83 X
TeamSiggyMorph_2 - 53.19 - 28.13 31.86 66.25 59.73 47.83 X
COATES_1 45.42 64.43 9.84 40.74 37.55 72.82 56.02 46.69
BASELINE 44.19 51.23 8.54 41.62 18.17 14.22 57.24 33.60

Track 2

Submission arp ddo git lez ntu nyb usp AVG Partial submission?
Tü-CL_2 91.37 92.01 50.22 87.61 92.32 91.40 84.51 84.21
SigMoreFun_2 89.34 88.15 52.39 82.36 85.53 89.49 83.08 81.48
LISNTeam_1 - 91.39 50.80 87.17 92.60 - 82.42 80.88 X
SigMoreFun_1 91.36 84.35 47.47 80.17 88.35 85.84 80.08 79.66
Tü-CL_1 90.93 91.16 17.08 83.45 90.17 89.96 83.45 78.03
LISNTeam_2 - - 51.09 86.52 92.77 - - 76.79 X
TeamSiggyMorph_2 0.03 88.36 47.76 86.59 92.10 82.74 82.22 68.54
BASELINE 91.11 85.34 25.33 51.82 49.03 88.71 82.48 67.69
SigMoreFun_4 80.81 78.24 12.74 50.00 63.39 85.30 73.25 63.39
SigMoreFun_3 72.10 57.93 2.60 26.24 35.62 70.01 67.73 47.46