Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[add] bias-var trade-off in resampling: make clearer / more explicit #1202

Open
lisa-wm opened this issue Feb 8, 2024 · 0 comments
Open

Comments

@lisa-wm
Copy link
Collaborator

lisa-wm commented Feb 8, 2024

➕ ➕ ➕

⚠️ Please provide specific & actionable issue titles!

Chapter name / context

Performance evaluation, resampling

Description

  • Conflicting goals: large train sets (for low bias) and large test sets (for low variance) ➡️ make crystal-clear why we need resampling and how we balance conflicting goals; and what we average over when aggregating over folds / repeating CV
  • Explain: what's the problem with estimating variance in CV?
  • Explain: what's the problem with LOO-CV?

Additional sources

...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant