Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compute metrics during evaluation, not during training #48

Open
2 tasks
FrancescoCasalegno opened this issue May 3, 2022 · 0 comments
Open
2 tasks
Labels
enhancement New feature or request

Comments

@FrancescoCasalegno
Copy link
Contributor

Context

Currently we are computing all metrics during the model training. This is true both for:

Actions

  • Make sure that nowhere else in the code (e.g. during evaluation) we are assuming that the checkpoint.chk produced during training contains metrics scores.
  • Move the computation of metrics scores from training stage to evaluation stages.

See also

#45 (comment)

@FrancescoCasalegno FrancescoCasalegno added the enhancement New feature or request label May 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant