Abstract
While Receiver Operator Characteristic (ROC) curves have been a standard tool in the design and evaluation of binary classification problems, they have sometimes been blamed for ignoring some vital information in the evaluation process, such as predicted scores and the amount of information about the target that each instance carries. In this paper, a new classification performance method denoted as 3D ROC histogram is proposed for extending ROC curves into 3D space. In this histogram, the x-axis and the y-axis are respectively labeled as false positive rate, and true positive rate which are the same with traditional ROC space. The z-axis serves as a quantitative index that represents vital information, and the volume of the 3D ROC histogram (V3RH) acts as a summary index. The proposed method preserves merits such as robustness with respect to class imbalance and threshold independence, and also, it provides an easy way for incorporating additional information in the evaluation process. Experiments on real-world datasets were conducted, with results that confirmed it to be a reliable measure.
Highlights
In this paper, we investigated classification problems by building a classification model from a finite set of training instances with labels to predict behavior of test instances [1]
False positive rate and true positive rate are respectively plotted on x-axis and y-axis, and z-axis value is related to the unique information of each instance
In this paper, a 3D receiver operating characteristic (ROC) histogram is proposed as a new analysis tool for classification, including proposing a summary index of such a histogram (V3RH) for quantitatively representing classification performance
Summary
We investigated classification problems by building a classification model from a finite set of training instances with labels (or classes) to predict behavior of test instances [1]. Since there is a natural need to extend traditional ROC curves into a higher dimensional space, a new measure based on ROC analysis, the 3D ROC histogram, is proposed in this paper In this histogram, false positive rate and true positive rate are respectively plotted on x-axis and y-axis, and z-axis value is related to the unique information of each instance.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
