-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add is best model to training servicer #229
Add is best model to training servicer #229
Conversation
b60fb5f
to
90b4a5e
Compare
90b4a5e
to
811ddd3
Compare
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #229 +/- ##
==========================================
- Coverage 64.60% 62.83% -1.78%
==========================================
Files 40 47 +7
Lines 2195 2876 +681
==========================================
+ Hits 1418 1807 +389
- Misses 777 1069 +292 ☔ View full report in Codecov by Sentry. |
b10d4f9
to
14f81af
Compare
14f81af
to
3d62b13
Compare
Whenever we have a new model, a stream will yield a response. The client can utilize this to perform certain actions e.g. ilastik to propagateDirty any predictions performed on previous models.
3d62b13
to
c5b8bf6
Compare
The response of the best model stream will return an id. The id is increased by one, each time we have a new model. A client can identify if an action has been performed by an outdated model based on the id. If the current is greater, then a new best model exists.
c5b8bf6
to
44bc634
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hello @thodkatz,
this is great I don't think it needs any changes 👍
Edit: test failure on mac is a bit surprising (but then maybe not) and needs investigation.
It builds upon #228 .
Whenever we have a new best model, the
IsBestModel
stream will yield a response. The client can utilize this to perform certain actions e.g. ilastik topropagateDirty
any predictions performed on previous models.