Assessing physical fit examinations of stabbed and torn textiles through a large dataset of casework-like items and interlaboratory studies.

Abstract

Several organizations have outlined the need for standardized methods for conducting physical fit comparisons. This study answers this call by developing and evaluating a systematic and transparent approach for examining, documenting, and interpreting textile physical fits, using qualitative feature descriptors and a quantitative metric (Edge Similarity Score, ESS) for the physical fit examination of textile materials. Here, the results from 1027 textile physical fit comparisons are reported. This includes the evaluation of inter and intraanalyst variation when using this method for hand-torn and stabbed fabrics. ESS higher than 80% and ESS lower than 20%, respectively, support fit and nonfit conclusions. The results show that analyst accuracy ranges from 88% to 100% when using this criterion. The estimated false-positive rate for this dataset (2% false positives, 10 of 477 true nonfit pairs) demonstrates the importance of assessing the quality of a physical fit during an examination and reveals that potential errors are low, but possible in textile physical fit examinations. The risk of error must be accounted for in the interpretation and verification processes. Further analysis shows that factors such as the separation method, construction, and design of the samples do not substantially influence the ESS values. Additionally, the proposed method is independently evaluated by 15 practitioners in an interlaboratory exercise that demonstrates satisfactory reproducibility between participants. The standardized terminology and documentation criteria are the first steps toward validating approaches to streamline the peer review process, minimize bias and subjectivity, and convey the probative value of the evidence.