Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Try different loss functions #228

Open
kirillbobyrev opened this issue Jun 16, 2024 · 0 comments
Open

Try different loss functions #228

kirillbobyrev opened this issue Jun 16, 2024 · 0 comments
Labels
evaluation Deep Learning-based policy and position evaluation P2 Priority 2: Want to do
Milestone

Comments

@kirillbobyrev
Copy link
Owner

At this point I'm using MSE or Huber loss to train the net, but suppose two examples:

  • q=.9, prediction q^=.7
  • q=.1, prediction q^=-.1

In both cases any kind of widely used errors would give the same loss. However, it is clear that case two is a huge problem, while the first case is quite OK - the engine is probably objectively winning in both cases.

This needs a careful consideration and SPRT testing setup, though, so deferring until the engine + eval is mature enough.

@kirillbobyrev kirillbobyrev added P2 Priority 2: Want to do brain labels Jun 16, 2024
@kirillbobyrev kirillbobyrev added this to the Strong milestone Jun 16, 2024
@kirillbobyrev kirillbobyrev added evaluation Deep Learning-based policy and position evaluation and removed brain labels Jun 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
evaluation Deep Learning-based policy and position evaluation P2 Priority 2: Want to do
Projects
None yet
Development

No branches or pull requests

1 participant