You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The idea of implementing "distribution fitters" as supervised models is to enable their evaluation using a proper scoring rule (which in turn makes hyper-parameter optimization possible).
There are precisely zero models implementing this API, but as currently specified, predict(mach, nothing) returns the fitted distribution. Now to evaluate using some examples using, say, log_score, we need a broadcast version of log_score(yhat, y) where yhat is a single distribution and y a number of observations (samples). Currently measures expect yhat and y to be arrays of the same dimension.
The text was updated successfully, but these errors were encountered:
The idea of implementing "distribution fitters" as supervised models is to enable their evaluation using a proper scoring rule (which in turn makes hyper-parameter optimization possible).
There are precisely zero models implementing this API, but as currently specified,
predict(mach, nothing)
returns the fitted distribution. Now to evaluate using some examples using, say,log_score
, we need a broadcast version oflog_score(yhat, y)
whereyhat
is a single distribution andy
a number of observations (samples). Currently measures expectyhat
andy
to be arrays of the same dimension.The text was updated successfully, but these errors were encountered: