You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Write a function that returns and tabulates/visualizes an expanded set of standard evaluation metrics for the fatality predictions.
The candidates I am considering are:
RMSE based on log(Y+1)
RMSE based on Y
RMSE based on log(Y+c) where c is another constant than 1 (0.1, 0.01, ...)
RMSE for non-zero actuals - based on log(Y+1)
RMSE for zero actuals - based on log(Y+1)
Average precision for predictions collapsed into categories
Some calibration metrics from the prediction competition
Some metrics based on aggregate data (e.g. distance from global mean)
-- if anyone has other suggestions, please shout out. Also, I would like to get hold of some of the presentation code from the prediction competition.
The text was updated successfully, but these errors were encountered:
Write a function that returns and tabulates/visualizes an expanded set of standard evaluation metrics for the fatality predictions.
The candidates I am considering are:
RMSE based on log(Y+1)
RMSE based on Y
RMSE based on log(Y+c) where c is another constant than 1 (0.1, 0.01, ...)
RMSE for non-zero actuals - based on log(Y+1)
RMSE for zero actuals - based on log(Y+1)
Average precision for predictions collapsed into categories
Some calibration metrics from the prediction competition
Some metrics based on aggregate data (e.g. distance from global mean)
-- if anyone has other suggestions, please shout out. Also, I would like to get hold of some of the presentation code from the prediction competition.
The text was updated successfully, but these errors were encountered: