TY - JOUR
T1 - Predicting/hypothesizing the findings of the M4 Competition
AU - Makridakis, Spyros
AU - Spiliotis, Evangelos
AU - Assimakopoulos, Vassilios
PY - 2020/1/1
Y1 - 2020/1/1
N2 - Science is caught up in a replication crisis which has negative implications for published findings that cannot be reproduced by other researchers. However, such is not the case with the M4 Competition, which not only provided the means of effectively reproducing its submissions, but also preregistered ten predictions/hypotheses about its expected results two-and-a-half months before its completion. From a scientific point of view, attempting to predict the results of a study is far more powerful than merely justifying them in hindsight after they have become available. The present paper presents these ten predictions/hypotheses that the organizers of the M4 Competition made and evaluates them based on the actual results. It is shown that at least six of the ten predictions/hypotheses were entirely correct, while two were partially correct, one required additional information to be confirmed, and the remaining one was not predicted correctly.
AB - Science is caught up in a replication crisis which has negative implications for published findings that cannot be reproduced by other researchers. However, such is not the case with the M4 Competition, which not only provided the means of effectively reproducing its submissions, but also preregistered ten predictions/hypotheses about its expected results two-and-a-half months before its completion. From a scientific point of view, attempting to predict the results of a study is far more powerful than merely justifying them in hindsight after they have become available. The present paper presents these ten predictions/hypotheses that the organizers of the M4 Competition made and evaluates them based on the actual results. It is shown that at least six of the ten predictions/hypotheses were entirely correct, while two were partially correct, one required additional information to be confirmed, and the remaining one was not predicted correctly.
UR - http://www.scopus.com/inward/record.url?scp=85069582255&partnerID=8YFLogxK
U2 - 10.1016/j.ijforecast.2019.02.012
DO - 10.1016/j.ijforecast.2019.02.012
M3 - Comment/debate
AN - SCOPUS:85069582255
SN - 0169-2070
VL - 36
SP - 29
EP - 36
JO - International Journal of Forecasting
JF - International Journal of Forecasting
IS - 1
ER -