Abstract
AbstractRationaleIn clinical and research settings, the validity and reliability of measurement instruments are crucial for reliable results. Current methods for computing validation metrics like Aiken's coefficients are often complex and error‐prone, highlighting the need for a standardized computational tool to simplify and enhance this process.Aims and ObjectivesThe objective of this study was to develop AikenCalc, a tool created to automate the calculation of Aiken coefficients. This tool provides a quantitative method for examining the validity and reliability of consensus among expert judges.MethodAikenCalc was developed with Shiny app, an R library that allows an easy‐to‐use interface and improved computational efficiency. It was validated using a convergence method by comparing the manual calculations with those obtained using AikenCalc. Additionally, to examine usability and interface, six experts evaluated their experience using AikenCalc and provided improvement feedback.ResultsAikenCalc demonstrated good convergent validity, closely aligning with the results obtained manually, and the six experts gave favorable ratings regarding the usability and interface of AikenCalc. Finally, it was shown that AikenCalc significantly reduced the time required for calculations, thanks to its user‐friendly interface.ConclusionAikenCalc represents a significant improvement in the validation of measurement instruments by automating and simplifying the calculation of Aiken's coefficients through a Shiny web application. Additionally, it fills a knowledge gap, as there is currently no similar calculator available in the field of research.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
