Dear Editor-in-Chief, Thank you for the opportunity to respond to the letter from Drs. Greenwald, Beckwith, Crisco, and Wilcox that raised concerns about the methodology and interpretation in our article (1). The authors highlight research in which the Head Impact Telemetry (HIT) System’s ability to detect impact has been corroborated through video review. These studies are designed to observe false positives—the HIT System reports a head impact that did not occur. However, these studies cannot identify false negatives—the HIT System does not report an impact that did occur. Like our study, which can and did detect false negatives, others (4) report a false-negative rate of approximately 20%. In the letter, the authors note that our article reported higher errors (lower coefficients of determination) than previously reported, but they incorrectly attribute this to limitations in our experimental protocol. The primary reason, however, is the difference in the error calculation method (see our Discussion, paragraph 3). We used a more conventional approach in statistical analyses (6) to estimate error associated with a given single measurement from the HIT System. Using this traditional definition of error with the data published in the most recent validation of the football HIT System in the letter of the authors (3), the error is 14% for linear acceleration, which is slightly lower than the error we reported (18%–31%) and greater than the 0.9% error reported in that article. In the letter, the authors raised concerns about the test biofidelity. The laboratory setting is generally a simplified analog of the real world, allowing for a systematic evaluation of test parameters on the outcomes of interest. We evaluated a range of impact directions and velocities, and we acknowledged (Discussion section, paragraphs 6–10) that other parameters such as fit, size, and material of the impacting surface likely influence the response. We elected to use the Hybrid III head form with limited structure on the underside of the chin and a spherical impacting ram for our testing to mimic published boxing (2) and football (3,5) studies by the authors. This, combined with the consistency of error results cited in the previous paragraph, suggests that our test protocol is as biofidelic as what has been used previously. Lastly, in the letter, the authors state that we “recommend applying [our] laboratory-derived ‘calibration factors’ to on-ice data without first considering plausibility.” We clearly stated in the Discussion (paragraph 4) that the published calibration factors “have potential,” but “further development of robust calibration equations should be subject of future study.” We commend the letter of the authors for developing the HIT technology and a business model that seeks to reduce the burden of TBI on society. We feel strongly, however, that the accuracy of such systems must be rigorously quantified as coaches and parents will make decisions about concussion risk and return to play based on player-specific data from such systems. We agree with the authors’ letter that validation is a multiphase process, and we recognize differences between in-play use and laboratory testing. Future research should incorporate laboratory-defined sensor accuracy into on-field investigations of injury risk and exposure. Kristy B. Arbogast, PhD Center for Injury Research and Prevention The Children’s Hospital of Philadelphia Department of Pediatrics, University of Pennsylvania Philadelphia, PA Mari A. Allison, BS Center for Injury Research and Prevention The Children’s Hospital of Philadelphia Department of Bioengineering University of Pennsylvania Philadelphia, PA Matthew R. Maltese, PhD Department of Anesthesiology and Critical Care Medicine, The Children’s Hospital of Philadelphia Philadelphia, PA John H. Bolte IV, PhD Yun Seok Kang, PhD Injury Biomechanics Research Laboratory The Ohio State University Columbus, OH
Read full abstract