Cross Validation of Prediction Models for Seasonal Time Series by Parametric Bootstrapping

  • Robert M. Kunst University of Vienna and Institute for Advanced Studies Vienna, Austria

Abstract

Out-of-sample prediction for the final portion of a sample is a popular tool for model selection in model-based forecasting. We suggest to add a simulation step to this exercise, where pseudo-samples are generated (parametrically bootstrapped), conditional on the observed data and on any of the candidate models, and these pseudo-samples are predicted using any of the candidate models. The technique is demonstrated by an artificial univariate time-series specification that highlights the main features, and also by
a real-life multivariate application to agricultural price data.


In the exemplary data set on quarterly European barley prices, strong seasonal
variation is obvious and represents a crucial feature in constructing good models for short-run prediction. Following some preliminary statistical testing, we restrict focus to vector autoregressions with deterministic seasonal cycles. We also consider a restricted specification that imposes a common seasonal cycle on all countries. While the restriction is formally rejected by hypothesis tests, it assists in reducing prediction errors. The parametric bootstrap experiments show that this improvement by using an invalid
restriction is systematic.

References

Clements, M. P., and Smith, J. (1999). A Monte Carlo study of the forecasting performance of empirical SETAR models. Journal of Applied Econometrics, 14, 123-141.

Dhrymes, P. (1998). Time Series, Unit Roots and Cointegration.

Franses, P. H. F., and Kunst, R. M. (2007). Analyzing a panel of seasonal time series: Does seasonality in industrial production converge across Europe? Economic Modelling, 24, 954-968.

Hylleberg, S., Engle, R. F., Granger, C. W. J., and Yoo, B. S. (1990). Seasonal integration and cointegration. Journal of Econometrics, 44, 215-238.

Inoue, A., and Kilian, L. (2006). On the selection of forecasting models. Journal of Econometrics, 130, 273-306.

Johansen, S. (1995). Likelihood-Based Inference in Cointegrated Vector Autoregressive Models. Oxford University Press.

Jumah, A., and Kunst, R.M. (2006). Seasonal cycles in European agricultural commodity prices. Economics Series, 192.

McQuarrie, A. D. R., and Tsai, C. (1998). Regression & Time Series Model Selection. World Scientific.

Rissanen, J. (2007). Information and Complexity in Statistical Modeling. Springer.

Shibata, R. (1980). Asymptotic efficient selection of the order of the model for estimating parameters of a linear process. Annals of Statistics, 8, 147-164.

Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions (with discussion). Journal of the Royal Statistical Society, Series B, 36, 111-147.

Wei, C. Z. (1992). On predictive least squares principles. Annals of Statistics, 20, 1-42.

Published
2016-04-03
How to Cite
Kunst, R. M. (2016). Cross Validation of Prediction Models for Seasonal Time Series by Parametric Bootstrapping. Austrian Journal of Statistics, 37(3&4), 271–284. https://doi.org/10.17713/ajs.v37i3&4.308
Section
Articles