Entropy Type Estimator to Simple Linear Measurement Error Models
DOI:
https://doi.org/10.17713/ajs.v34i3.418Abstract
The classical maximum likelihood estimation fails to estimate the simple linear measurement error model, with or without equation error, unless additional assumptions are made about the structural parameters. In the literature there are six different assumptions that could be added in order to solve the measurement error models. In this paper, we proposed an entropy-type estimator based on the generalized maximum entropy estimation approach, which allows one to abstract away from the additional assumptions that are made in the classical method. Monte Carlo experiments were carried out in order to investigate the performance of the proposed estimators. The simulation results showed that the entropy-type estimator of unknown parameters has outperformed the classical estimators in terms of mean square error criterion.
References
Al-Nasser, A. D. (2003a). Customer satisfaction measurement models: Generalized maximum entropy approach. Pakistan Journal of Statistics, 19, 213-226.
Al-Nasser, A. D. (2003b). Fitting nonlinear regression models using generalized maximum entropy. Abhath Al-Yarmouk:Basic Sci.& Eng., 11, 145-155.
Al-Nasser, A. D. (2004). Estimation of multiple linear functional relationships. Journal Of Modern Applied Statistical Methods, 3, 181-186.
Carroll, R. J., Ruppert, D., and Stefanski, L. A. (1995). Measurement Error in Nonlinear Models. London: Chapman & Hall.
Cheng, C.-L., and Ness, J. W. V. (1999). Statistical Regression with Measurement Error. New York: Arlond.
Csiszar, I. (1991). Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems. The Annals of Statistics, 19, 2032-2066.
Donho, D. L., Johnstone, I. M., Hoch, J. C., and Stern, A. S. (1992). Maximum entropy and nearly black object. Journal of the Royal Statistical Society, Series B, 54, 41-81.
Fuller, W. A. (1987). Measurement Error Models. New York: John Wiley.
Golan, A., Judge, G., and Miller, D. (1996). A Maximum Entropy Econometrics: Robust Estimation with Limited Data. New York: John Wiley.
Golan, A., Judge, G., and Perloff, J. (1997). Estimation and inference with censored and ordered multinomial response data. Journal of Econometrics, 79, 23-51.
Jaynes, E. T. (1957a). Information and statistical mechanics (ii). Physics Review, 108, 171-190.
Jaynes, E. T. (1957b). Information and statistical mechanics i. Physics Review, 106, 620-630.
Kendall, M. G., and Stuart, A. (1979). The Advanced Theory of Statistics. London: Grifn.
Kullback, J. (1959). Information Theory and Statistics. New York: John Wiley.
Levine, R. D. (1980). An information theoretical approach to inversion problems. Journal of Physics, A, 13, 91-108.
Lindley, D. V. (1947). Regression lines and linear functional relationship. Journal of the Royal Statistical Society, Supplement, 9, 218-244.
Madansky, A. (1959). The ghting of straight lines when both variables are subject to error. Journal of the American Statistical Society, 55, 173-205.
Pukelsheim, F. (1994). The three sigma rule. The American Statistician, 48, 88-91.
Roeder, K., Carroll, R. J., and Lindsay, B. G. (1996). A semiparametric mixture approach to case-control studies with errors in covariables. Journal of the American
Statistical Society, 91, 722-732.
Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423.
Skilling, J. (1989). The axioms of maximum entropy. In J. Skilling (Ed.), Maximum entropy and bayesian methods in science and engineering (p. 173-187). Dordecht: Kluwer Academic.
Downloads
Published
Issue
Section
License
The Austrian Journal of Statistics publish open access articles under the terms of the Creative Commons Attribution (CC BY) License.
The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed.
Copyright on any research article published by the Austrian Journal of Statistics is retained by the author(s). Authors grant the Austrian Journal of Statistics a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified.
Manuscripts should be unpublished and not be under consideration for publication elsewhere. By submitting an article, the author(s) certify that the article is their original work, that they have the right to submit the article for publication, and that they can grant the above license.
How to Cite
