Forecasting in social settings: The state of the art

Spyros Makridakis, Rob J. Hyndman, Fotios Petropoulos

    Research output: Contribution to journalArticlepeer-review

    Abstract

    This paper provides a non-systematic review of the progress of forecasting in social settings. It is aimed at someone outside the field of forecasting who wants to understand and appreciate the results of the M4 Competition, and forms a survey paper regarding the state of the art of this discipline. It discusses the recorded improvements in forecast accuracy over time, the need to capture forecast uncertainty, and things that can go wrong with predictions. Subsequently, the review classifies the knowledge achieved over recent years into (i) what we know, (ii) what we are not sure about, and (iii) what we don't knowIn the first two areas, we explore the difference between explanation and prediction, the existence of an optimal model, the performance of machine learning methods on time series forecasting tasks, the difficulties of predicting non-stable environments, the performance of judgment, and the value added by exogenous variables. The article concludes with the importance of (thin and) fat tails, the challenges and advances in causal inference, and the role of luck.

    Original languageEnglish
    Pages (from-to)15-28
    Number of pages14
    JournalInternational Journal of Forecasting
    Volume36
    Issue number1
    DOIs
    Publication statusPublished - 1 Jan 2020

    Keywords

    • Accuracy
    • Causality
    • Judgment
    • Knowns and unknowns
    • Machine Learning
    • Review
    • Uncertainty

    Fingerprint

    Dive into the research topics of 'Forecasting in social settings: The state of the art'. Together they form a unique fingerprint.

    Cite this