Web-Bootstrap Estimate of Area Under ROC Curve
DOI:
https://doi.org/10.17713/ajs.v35i2&3.379Abstract
The accuracy of binary discrimination models (discrimination between cases with and without any condition) is usually summarized by classification matrix (also called a confusion, assignment, or prediction matrix). Receiver operating characteristic (ROC) curve can visualize the association between probabilities of incorrect classification of cases from the group without condition (False Positives) versus the probabilities of correct classification
of cases from the group with condition (True Positives) across all the possible cut-point values of discrimination score.
Area under ROC curve (AUC) is one of summary measures. This article describes the possibility of AUC estimate with the use of web based application of bootstrap (resampling). Bootstrap is useful mainly to data for which any distributional assumptions are not appropriate. The quality of the bootstrap application was evaluated with the use of a special programme written in C#.NET language that allows to automate the process of repeating different experiments. Estimates of AUC and confidence limits given by bootstrap method were compared with bi-normal and nonparametric estimates. Results
indicate that usually bootstrap confidence intervals are narrower than nonparametric
one, mainly for small data samples.
References
Berka, P. (2001). Discovery challenge: modelová data dobývání znalostí z realistických dat. In Proceedings Znalosti 2001 (p. 547-553). Prague: VšE.
Gentle, J. E. (2002). Elements of Computational Statistics. New York: Springer Verlag.
Hanley, J. A., and McNeil, B. J. (1982). The meaning and use of the areas under a receiver operating characteristic (ROC) curve. Radiology, 143, 29-36.
Hintze, J. (2005). NCSS. In NCSS and PASS. Number Cruncher Statistical Systems. Kayswille, Utah: www.ncss.com.
Metz, C. E. (2003). ROCkit. In http://xray.bsd.uchicago.edu. University of Chicago: Kurt Rossmann Laboratories.
Prášková, Z. (2004). Metoda bootstrap. In Robust 2004 (p. 299-314). Prague: JČMF.
Skalská, H. (2003). Software tools for ROC and AUC estimates. In Proceedings of the 21th international conference MME 2003 (p. 238-243). Prague: VŠE.
Downloads
Published
Issue
Section
License
The Austrian Journal of Statistics publish open access articles under the terms of the Creative Commons Attribution (CC BY) License.
The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed.
Copyright on any research article published by the Austrian Journal of Statistics is retained by the author(s). Authors grant the Austrian Journal of Statistics a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified.
Manuscripts should be unpublished and not be under consideration for publication elsewhere. By submitting an article, the author(s) certify that the article is their original work, that they have the right to submit the article for publication, and that they can grant the above license.
How to Cite
