Sparse Parameter Estimation in Overcomplete Time Series Models
DOI:
https://doi.org/10.17713/ajs.v35i2&3.385Abstract
We suggest a new approach to parameter estimation in time series models with large number of parameters. We use a modified version of the Basis Pursuit Algorithm (BPA) by Chen et al. [SIAM Review 43 (2001), No. 1] to verify its applicability to times series modelling. For simplicity we restrict to ARIMA models of univariate stationary time series. After having accomplished and analyzed a lot of numerical simulations we can drawthe following conclusions: (1) We were able to reliably identify nearly zero parameters in the model allowing us to reduce the originally badly conditioned overparametrized model. Among others we need not take care about model orders the fixing of which is a common preliminary step used by standard techniques. For short time series paths (100 or less samples) the sparse parameter estimates provide more precise predictions compared with those based on standard maximum likelihood estimators from MATLAB’s System
Identification Toolbox (IDENT). For longer paths (500 or more) both techniques yield nearly equal prediction paths. (2) As the model usually depends on the estimated parameters, we tried to improve their accuracy by iterating BPA several times.
References
Brockwell, P. J., and Davis, R. A. (1991). Time series: Theory and Methods (2-nd ed.). New York: Springer-Verlag.
Chen, S. S., Donoho, D. L., and Saunders, M. A. (1998). Atomic decomposition by basis pursuit. SIAM Journal of Scientific Computing, 20, 33-61. (reprinted in SIAM Review, 43 (2001), no. 1, pp. 129-159)
Ljung, L. (2002, July). System identification toolbox for use with MATLAB – User’s guide. 24 Prime Park Way, Natick, Mass. 01760.
Veselý, V. (2002). Hilbert-space techniques for spectral representation in terms of overcomplete bases. In I. Horová (Ed.), Proceedings of the Summer School DATASTAT’2001, Čihák near Žamberk (Vol. 11, p. 259-273). Masaryk University, Brno
(Czech Rep.)1.
Zelinka, J., Veselý, V., and Horová, I. (2004). Comparative study of two kernel smoothing techniques. In I. Horová (Ed.), Proceedings of the Summer School DATASTAT’2003, Svratka (Vol. 15, p. 419-436). Masaryk University, Brno (Czech Rep.).
Downloads
Published
Issue
Section
License
The Austrian Journal of Statistics publish open access articles under the terms of the Creative Commons Attribution (CC BY) License.
The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed.
Copyright on any research article published by the Austrian Journal of Statistics is retained by the author(s). Authors grant the Austrian Journal of Statistics a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified.
Manuscripts should be unpublished and not be under consideration for publication elsewhere. By submitting an article, the author(s) certify that the article is their original work, that they have the right to submit the article for publication, and that they can grant the above license.
How to Cite
