Cross Validation of Prediction Models for Seasonal Time Series by Parametric Bootstrapping
DOI:
https://doi.org/10.17713/ajs.v37i3&4.308Abstract
Out-of-sample prediction for the final portion of a sample is a popular tool for model selection in model-based forecasting. We suggest to add a simulation step to this exercise, where pseudo-samples are generated (parametrically bootstrapped), conditional on the observed data and on any of the candidate models, and these pseudo-samples are predicted using any of the candidate models. The technique is demonstrated by an artificial univariate time-series specification that highlights the main features, and also by
a real-life multivariate application to agricultural price data.
In the exemplary data set on quarterly European barley prices, strong seasonal
variation is obvious and represents a crucial feature in constructing good models for short-run prediction. Following some preliminary statistical testing, we restrict focus to vector autoregressions with deterministic seasonal cycles. We also consider a restricted specification that imposes a common seasonal cycle on all countries. While the restriction is formally rejected by hypothesis tests, it assists in reducing prediction errors. The parametric bootstrap experiments show that this improvement by using an invalid
restriction is systematic.
References
Clements, M. P., and Smith, J. (1999). A Monte Carlo study of the forecasting performance of empirical SETAR models. Journal of Applied Econometrics, 14, 123-141.
Dhrymes, P. (1998). Time Series, Unit Roots and Cointegration.
Franses, P. H. F., and Kunst, R. M. (2007). Analyzing a panel of seasonal time series: Does seasonality in industrial production converge across Europe? Economic Modelling, 24, 954-968.
Hylleberg, S., Engle, R. F., Granger, C. W. J., and Yoo, B. S. (1990). Seasonal integration and cointegration. Journal of Econometrics, 44, 215-238.
Inoue, A., and Kilian, L. (2006). On the selection of forecasting models. Journal of Econometrics, 130, 273-306.
Johansen, S. (1995). Likelihood-Based Inference in Cointegrated Vector Autoregressive Models. Oxford University Press.
Jumah, A., and Kunst, R.M. (2006). Seasonal cycles in European agricultural commodity prices. Economics Series, 192.
McQuarrie, A. D. R., and Tsai, C. (1998). Regression & Time Series Model Selection. World Scientific.
Rissanen, J. (2007). Information and Complexity in Statistical Modeling. Springer.
Shibata, R. (1980). Asymptotic efficient selection of the order of the model for estimating parameters of a linear process. Annals of Statistics, 8, 147-164.
Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions (with discussion). Journal of the Royal Statistical Society, Series B, 36, 111-147.
Wei, C. Z. (1992). On predictive least squares principles. Annals of Statistics, 20, 1-42.
Downloads
Published
Issue
Section
License
The Austrian Journal of Statistics publish open access articles under the terms of the Creative Commons Attribution (CC BY) License.
The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed.
Copyright on any research article published by the Austrian Journal of Statistics is retained by the author(s). Authors grant the Austrian Journal of Statistics a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified.
Manuscripts should be unpublished and not be under consideration for publication elsewhere. By submitting an article, the author(s) certify that the article is their original work, that they have the right to submit the article for publication, and that they can grant the above license.
How to Cite
