Rasch Model Research Articles

Validation of the Arabic eHealth literacy questionnaire: a factor and Rasch analysis study

Validation of the Arabic eHealth literacy questionnaire: a factor and Rasch analysis study

Using the HBSC Symptom Checklist to measure junior secondary school students’ psychosomatic complaints in the Chinese Mainland: Rasch-based validation, population-based norm, and norm-referenced scoring algorithm

BackgroundThe Symptom Checklist (SCL) developed by the Health Behaviour in School‑aged Children (HBSC) study is widely used to capture the psychosomatic complaints (PSC) of non-clinical children and adolescents. Although its psychometric properties have been well established internationally, the performance of the Mandarin Chinese version remains unclear. This study evaluates the Mandarin Chinese HBSC-SCL’s psychometric properties, develops its norm, and creates the corresponding scoring algorithm.MethodsData were collected from a two-wave cross-sectional survey conducted between June 20 and July 11, 2022, across eight Chinese Human Geography Regions (CHGRs). The sample included 3290 junior secondary school students, obtained through convenience sampling (first wave) and multistage, stratified, cluster sampling (second wave). The surveys were administered anonymously in the school setting, using a paper-and-pencil, self-administered questionnaire. The Mandarin Chinese HBSC-SCL’s unidimensionality was verified using confirmatory factor analysis (CFA), and its psychometric properties were comprehensively evaluated using the partial credit model (PCM) of the Rasch measurement method. Based on the above scientific evidence, the population-based norm and norm-referenced scoring algorithm were developed and created.ResultsThe CFA confirmed that the HBSC-SCL can be considered unidimensional in the Chinese Mainland. Evidence-based on the six features of the Rasch model indicated that the Mandarin Chinese HBSC-SCL has satisfactory psychometric properties. All 5-category rating scales of eight items appropriately differentiated the students’ PSC and demonstrated strong goodness-of-fit. This version also exhibited good unidimensionality and local independence. The Rasch model generated two kinds of reliability indicators, with the item indicators performing well. The person-item map demonstrated acceptable person and item matches, and provided new perspectives for future improvements. Additionally, no substantial uniform differential item functioning (UDIF) was detected across 13 groups (e.g., survey waves, gender, chronological age).ConclusionsThe Mandarin Chinese HBSC-SCL demonstrates satisfactory psychometric properties and performs well in the Chinese Mainland context. It provides concise self-reported PSC measures for junior secondary school students, potentially applicable to a broader Chinese-speaking population. Its ease of administration, scoring, and interpretation makes it suitable for routine school monitoring, large-scale population surveys, and clinical applications. Additionally, the population-based norm and norm-referenced scoring algorithm support the broader application of this version and offer new insights for interpreting PSC sum scores.

Argument-based validation of Chulalongkorn University Language Institute (CULI) test: a Rasch-based evidence investigation

Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane’s argument-based validation and Rasch measurement approaches to construct the validity argument for the CULI test. This study analysed score data from a single test administration involving 237 test-takers and used a dichotomous Rasch model for the data analysis in Winsteps. The Rasch results indicated appropriate psychometric properties of the CULI test. Overall, the Rasch-based evidence reasonably contributes to the validity argument for the CULI test. Specifically, it partly supports the plausibility of the claims that CULI test tasks and contents represent those in the intended target language use (TLU) domain, and CULI test scores accurately summarise test-takers’ performance and reflect test-takers’ performance consistency, the intended construct, and language performance levels in the TLU domain. Although the CULI test showed sound psychometric functioning, the Rasch results indicated the need for further investigation into certain correct and incorrect choices and the difficulty levels of writing items, which could provide valuable insights for optimising test quality. This study offers implications for future research on argument-based and Rasch-based validation.

Android-Based Prototype for Early Tuberculosis Detection via Clinical Symptoms

Background: Health technology has enormous potential for preventing and curing TB. As a result, this research aims to create a prototype of an early detection tool for clinical symptoms based on Android. Methods: The Cure-TB application prototype is being developed through Research and Development, type 4D (Define, Design, Develop, and Disseminate). A total of 45 potential users evaluated the Cure-TB prototype utilizing 10 System Usability Scale (SUS) criteria. The SUS scale employs a five-point scale ranging from 1 (Strongly Disagree) to 5 (Strongly Agree). The SUS scale's item dependability is 0.91, and its Cronbach's alpha coefficient is 0.68. Prospective users' test results were examined using Rasch modelling approaches such as Logit Value of Person (LVP), Logit Value of Item (LVI), and Wright map. Results: Cure-TB contains seven main elements that help in the treatment of tuberculosis. The seven elements provided support the role of each user, which includes patients, health staff, and the general public. The SUS test findings showed a score of 75, meaning that the Cure-TB application received good feedback from most prospective users. Feedback from users that it takes time to get used to the various features provided. Conclusion: The Android-based Cure-TB application provides a unique option for early tuberculosis identification, enhancing patient treatment compliance and monitoring patients' side effects and nutritional condition.

FACTORS ASSOCIATED WITH LOW PERCEIVED RISK OF DENGUE INFECTION IN SEREMBAN DISTRICT, NEGERI SEMBILAN: A CROSS-SECTIONAL STUDY

Introduction: Dengue fever is an infection caused by dengue virus that remains as a public health threat. Hence, this study aimed to determine the risk perception level of dengue infection at Seremban district that continues to battle with dengue epidemic. Additionally, we aimed to measure knowledge, attitude, and practice of the Seremban population in relation to their dengue risk perception level. Methods: This is an analytical cross-sectional survey using a validated questionnaire- Risk Perception, Attitude and Practice (RPAP). A pilot test was conducted on 35 samples, and data was analyzed prior to actual study. The subsequent population study was conducted between April 2021 to November 2021. Ethical approval was obtained before commencement, and each respondent’s informed consent was taken prior to study inclusion. Statistical analysis was done using Rasch analysis and multiple logistic regression. Results: A total of 341 respondents were included in the population study. Rasch analysis result for reliability analysis showed a good psychometric property of the tool used. Majority of the respondents have low level of dengue risk perception (82.1%), attitude level (77.7%), and dengue prevention practice level (84.5%). There was no statistical difference upon comparison between those who live in dengue outbreak area and those from non-outbreak area, for all three constructs (RPAP). The bivariable and multivariable analysis done yielded three independent factors that contributed to the low level of dengue risk perception, namely, living in rented house, living in high-rise unit, and family history of dengue infection. Conclusion: The population of Seremban district has a low level of dengue risk perception that may reflect a low level of attitude and dengue preventive action. Hence, a more extensive health promotion and health education activity based on behavioral theory such as Health Belief Model need to be done to reinforce good attitude and good practice of dengue prevention.

Development and Validation of the EBP-Affinity Questionnaire: A Mixed-Method Study.

Implementation of evidence-based practice (EBP) in nursing homes is important to improve quality of care and reduce costs. These facilities primarily employ certified nurse assistants (CNAs) and vocationally-trained registered nurses (VTRNs). Although EBP is scarcely addressed in their education, these caregivers have an important role in EBP. Insight into their affinity with EBP could provide a good starting point for working according to EBP. To develop a questionnaire that measures affinity with EBP amongst CNAs and VTRNs in nursing homes. To assess the reliability and validity of the questionnaire. Mixed-method design according to the COSMIN-checklist. Phase 1: the questionnaire was developed in three steps: (1) gathering items from existing questionnaires, occupational profiles and interviews; (2) compression through consensus rounds and (3) a pilot study. Phase 2: psychometric properties were assessed amongst CNAs and VTRNs in nine nursing homes. The factors extracted through principal component analysis were tested for measurement invariance using the one-parameter Rasch model. Phase 1: all experts interviewed (N = 5) indicated CNAs and VTRNs can play specific and significant roles in EBP. A 26-item questionnaire was created through two consensus rounds with experts (N = 7) and a pilot study (N = 7). Phase 2: Principal component analysis revealed a two-factor structure with good internal reliability (N = 428 questionnaires). All items exhibited good fit with the Rasch model and measurement invariance for CNAs and VTRNs. CNAs and VTRNs can fulfil important roles in EBP in nursing homes. The 'Evidence-Based Practice-Affinity Questionnaire' is reliable and valid for assessing affinity with EBP amongst CNAs and VTRNs to improve practice and research, and can guide tailored training programs for CNAs and VTRNs, enhancing evidence-based practices in nursing homes. The research provides insight into the roles CNAs and VTRNs can play in EBP and how to measure their affinity with EBP, which contributes to implementation of EBP in nursing homes. No patient or public contribution in the study.

Development and validation of Indonesian youth career identity scale: the Rasch analysis

Development and validation of Indonesian youth career identity scale: the Rasch analysis

Psychometric validation of the Danish BREAST-Q reconstruction module.

Patient-reported outcome measurement instruments are important tools in understanding a breast reconstruction's impact on the patients' quality of life. A psychometric validation is essential before applying a patient-reported outcome measurement instrument in clinical practice and research. The BREAST-Q is a specific, validated questionnaire for breast surgery outcomes that has been translated from English to Danish. It consists of 167 items in 7 pre-operative scales and 15 post-operative scales. This validation study aims to validate the Danish BREAST-Q reconstruction module. Eligible women were included from January 2019 to June 2020. Multiple-item scales with summated scores and more than 40 complete responses were eligible for psychometric validation, and psychometric analyses examined reliability and validity using Rasch Analyses and Classical Test Theory. Measurements included test for local response dependence, item fit, differential item functioning, and more. Clinical validity was assessed using known-groups hypotheses. We obtained 115 and 201 complete responses pre-and postoperatively, respectively. We validated 120 items in four preoperative and nine postoperative scales. The Rasch analyses disclosed evidence of local response dependence in eight scales. Chronbach's α ranged 0.81-0.95 after adjustment. Item fit was evaluated using item-restscore correlations and showed good fit in 98% of items. Differential Item Functioning was found in four items but had very little effect on the model. Clinical validity was supported by the know-group analyses. The Danish BREAST-Q reconstruction module has good acceptability, feasibility and validity, and adequate reliability. The results support the use in a Danish population.

A many-facet Rasch measurement model approach to investigating objective structured clinical examination item parameter drift.

Objective Structured Clinical Examinations (OSCEs) are widely used for assessing clinical competence, especially in high-stakes environments such as medical licensure. However, the reuse of OSCE cases across multiple administrations raises concerns about parameter stability, known as item parameter drift (IPD). AIMS &OBJECTIVES: This study aims to investigate IPD in reused OSCE cases while accounting for examiner scoring effects using a Many-facet Rasch Measurement (MFRM) model. Data from 12 OSCE cases, reused over seven administrations of the Internationally Educated Nurse Competency Assessment Program (IENCAP), were analyzed using the MFRM model. Each case was treated as an item, and examiner scoring effects were accounted for in the analysis. The results indicated that despite accounting for examiner effects, all cases exhibited some level of IPD, with an average absolute IPD of 0.21 logits. Three cases showed positive directional trends. IPD significantly affected score decisions in 1.19% of estimates, at an invariance violation of 0.58 logits. These findings suggest that while OSCE cases demonstrate sufficient stability for reuse, continuous monitoring is essential to ensure the accuracy of score interpretations and decisions. The study provides an objective threshold for detecting concerning levels of IPD and underscores the importance of addressing examiner scoring effects in OSCE assessments. The MFRM model offers a robust framework for tracking and mitigating IPD, contributing to the validity and reliability of OSCEs in evaluating clinical competence.

The equivalence of a high-stakes objective structured clinical exam adapted to suit a virtual delivery format.

The COVID-19 pandemic necessitated rapid adaptation of clinical competence assessments, including the transition of Objective Structured Clinical Examinations (OSCE) from in-person to virtual formats. This study investigates the construct equivalence of a high-stakes OSCE, originally designed for in-person delivery, when adapted for a virtual format. A retrospective analysis was conducted using OSCE scores from the Internationally Educated Nurse Competency Assessment Program (IENCAP®). Data were collected from 15 exam administrations between January 2018 and June 2022, encompassing 2021 examinees (1936 in-person, 85 virtual). The Many-Facet Rasch Measurement (MFRM) model was employed to analyze the invariance of examinee ability, case difficulty, and criteria difficulty across in-person and virtual formats. Results revealed overall examinee ability estimates remained invariant regardless of the OSCE format, while invariant violations were identified in only three of the 15 cases (N = 20%) adapted to suit the virtual format. The most significant adaptation, namely the use of a verbal physical examination to suit the virtual context achieved equivalence to its hands-on in-person counterpart given evidence of invariance across criteria estimates. Interestingly, criteria scores in invariant violated cases displayed a higher level of stability or consistency across the virtual OSCE formats versus their in-person counterpart highlighting a potential benefit of the virtual versus in-person format and potentially linked to the verbal physical examination. The study found that while examinee ability and case difficulty estimates exhibited some invariance between in-person and virtual OSCE formats, criteria involving physical assessments faced challenges in maintaining construct equivalence. These findings highlight the need for careful consideration in adapting high-stakes clinical assessments to virtual formats to ensure fairness and reliability.

Assessment Of Scientific Reasoning-Communication Skills (Sr-Cs) Test on Work and Energy Concept: Development, Content Validity and Rasch Model Analysis

Studies indicate that scientific reasoning assessments are still rarely integrated as higher-level assessments and new science education standards in school instruction. This study aims to develop a scientific reasoning skills test instrument that is integrated with a scientific communication skills test instrument (SR-CS test) on work and energy concept. This study used the ADDIE procedure. The research procedure consists of five stages including analyzing, designing, developing, implementing, and evaluating. The initial draft of SR-CS test consisted of 14 multiple choice scientific reasoning skills (SRS) questions and 8 open-ended scientific communication skills (SCS) questions. The results of the expert judgement were analyzed using the content validity index (CVI) and obtained a value of 0,94 (very suitable) for the SRS instrument and 0.97 (very suitable) for the SCS instrument. After being revised based on the expert suggestions, the test instrument was tested on 25 students (15 girls,10 boys) aged 16-17 years. The trial data were analyzed using the Rasch Model to obtained item fit (validity), reliability, distinction level, and difficulty level. The results show that 14 questions of SRS instrument have item validity and 8 questions of SCS instrument have item validity. Besides that, the item reliability of the SRS and SCS test instrument is 0.79 and 0.91, respectively. Meanwhile, the person reliability is 0.82 (SRS) and 0.91 (SCS). Therefore, the SR-CS test is valid and reliable so that it can be used to measure scientific reasoning skills and scientific communication skills of students in further research.

Validating the parental reflective functioning questionnaire - infant version using a rasch model.

Parental reflective functioning is the parent's ability to reflect on the psychological processes in their child and in themselves as a parent. Recently, an infant version of the Parental Reflective Functioning Questionnaire, PRFQ-I, has been developed and validated using confirmatory factor analyses. The present study aims to validate the PRFQ-I using a Rasch model in a sample of 531 Danish mothers at risk of depression and their infants aged 2-11 months. Our findings indicate that seven response categories were too many for the mothers to distinguish across all items. Prementalizing showed adequate psychometric properties, while Certainty of Mental States and Interest and Curiosity required recoding with 4 and 5 as the optimal scores, respectively. After rescoring, both subscales overall showed adequate psychometric properties. However, shortening Certainty of Mental States may be advisable due to local dependency between items 8 and 17. Additionally, items 2 and 14 ("I always know what my child wants" and "I always know why I do what I do to my child") may function better as a separate subscale. We recommend that scores on both Certainty of Mental States and Interest and Curiosity should be analyzed and interpreted in a curvilinear rather than linear manner.

Implementation of the Learning Cycle 9E with Real-Virtual Practicum to Improve Students' Critical Thinking Skills

Rapid advancements in science and technology have made critical thinking skills increasingly essential. 21st-century education focuses not only on knowledge transfer but also on developing crucial skills to meet future challenges. This study examines the enhancement of students' critical thinking skills by implementing the Learning cycle of the 9E model, which integrates real and virtual practicums on dynamic fluid materials. The research used a pre-experimental design with a pretest-posttest approach involving 27 grade XI students selected via purposive sampling. Data were collected using a critical thinking skills test with 19 two-level multiple-choice questions and analyzed with Rasch modeling techniques. Results showed that the Learning cycle of the 9E model, combining real and virtual practicums, improved students' critical thinking skills by 5.74 logits, indicating a medium level of improvement. The racking technique revealed that initially, difficult questions became easier post-intervention, highlighting a positive impact on learning. Thus, the Learning cycle of the 9E model with real-virtual practicums effectively enhances students' critical thinking skills in dynamic fluid materials. These findings have significant theoretical and practical implications, supporting classroom learning and educational policies. The stacking and racking techniques provide deeper and more accurate analysis results.

Item-level measurement properties of the pediatric awareness and sensory motor assessment in children with medical complexity

IntroductionChildren with medical complexity (CMC) are medically fragile with severe brain damage and chronic conditions, necessitating daily care. Their neurological impairments often limit participation in childhood activities, affecting quality of life. Current assessment tools fail to detect subtle abilities in CMC, hindering development of effective rehabilitation goals and interventions. The Pediatric Awareness and Sensory Motor Assessment (PASMA) was created to fill this gap, providing sensitive measurement of sensory awareness and motor response across five domains (i.e., olfactory, visual, auditory, gustatory, and tactile).MethodsIn this retrospective study, a Rasch analysis was conducted on PASMA data for CMC. The PASMA was administered five times over ten weekdays to each child, reflecting its intended clinical use to gain a reliable sense of each child's awareness.ResultsAnalysis of data from 36 CMC revealed that the PASMA is sufficiently unidimensional, effectively measuring sensory awareness and motor response as a single construct. Its rating scale structure was validated without modifications, and the item hierarchy matched clinical expectations. High item reliability (0.97) was observed, with one item (V2 blink in response to light) slightly misfitting, but without affecting overall measures. Adequate person reliability was observed (0.81), with 15% person misfit. Person misfit did not degrade item measures or model statistics. Differential item functioning (DIF) was noted for the three easiest items on specific days. The PASMA successfully stratified participants into three distinct awareness levels (low, medium, and high awareness), without floor or ceiling effects.DiscussionThe PASMA is a valid unidimensional measure of sensory awareness and motor response in CMC. Rating scale characteristics, item hierarchy, and person separation measures all support the PASMA's measurement properties within this heterogeneous sample of CMC. DIF findings support a potential reduction in the recommended number of PASMA administrations per individual. Future research will focus on establishing rater reliability and external validity. Additional efforts will support health professionals to utilize the PASMA for baseline assessments, guiding personalized interventions, and tracking progress.ConclusionClinical use of the PASMA could provide new opportunities to detect subtle abilities, preferences, and changes in CMC, to promote meaningful participation and improve quality of life.

Validity and Reliability of Patient Activation Measure (PAM13-I) Italian Version Among Patient Undergoing Elective Surgery.

The patient activation measure (PAM), a recognized measure of how active patients are in their care, is one of the most extensively used, widely translated, and tested instruments worldwide in measuring patient activation. This study aimed to assess the psychometric properties and construct validity of the Italian version of the 13-item Patient Activation Measure (PAM13-I) among patients undergoing elective laparoscopic cholecystectomy. A multicenter study was conducted across 111 surgical units in Italy. This study involved the preoperative administration of the PAM questionnaire to 4532 patients. The psychometric properties of the PAM were evaluated using Rasch analysis. The PAM13-I demonstrated good internal consistency (Cronbach's α = 0.95) and reliability indices. While fit statistics were acceptable, ceiling effects were observed. No significant differential item functioning was found. However, issues with targeting and local response dependency were identified. The Italian PAM-13 showed promising psychometric properties among surgical patients, indicating its potential utility in assessing patient activation. However, concerns regarding ceiling effects and targeting suggest the need for further refinement and validation in surgical populations.

LAPS SA: Measuring Attachment to Dogs and Cats Among South American Countries.

Human biological and cultural evolution is tied to the relationships established with other animals. Attachment is one of the mechanisms established between dogs/cats and humans and allows the generation of affective bonds and close proximity. Many instruments have been used to study attachment of people to their dogs/cats, such as the Lexington Attachment to Pets Scale (LAPS). Our aim was adapting LAPS for South American populations (Brazil, Argentina, Chile, Uruguay, Peru and Colombia), and its languages (Brazilian Portuguese and South American Spanish) and evaluating them with South American data. We translated and back translated the instrument, examined versions with a pilot sample and collected data from 2832 respondents (18-85 y.o.), who lived with at least one cat/dog. We report and compare findings from psychometric analyses of the two versions of LAPS using both classical test (coefficient alpha, confirmatory factor analysis) and item response theory (Rasch analysis) methodologies. Findings demonstrate the comparability of the versions while observing some minor differences in their dimensionality. As in the original LAPS, results suggest one main dimension (general attachment) that assesses the general relationship between a person and a companion animal. We suggest that using appropriate language (e.g., companions and guardians instead of pets and owners) will improve understanding. We emphasize the importance of adapting wording and content of research tools considering cultural aspects of the populations studied. We introduce LAPS SA (LAPS South America) as a unified instrument to measure attachment between people and companion animals. Implications for the use of LAPS SA and future research are discussed.

Development of Physics Learning Media Integrated with Rebuttal Text (PhyLeM-ReT) on Work and Energy Material

This study aimed to develop Physics Learning Media assisted by Rebuttal Texts (PhyLeM-ReT), integrated with the Predict, Observe, Explain, Apply, and Write (POEAW) model for work and energy material. The development research design employed in this study was ADDIE (Analysis, Design, Development, Implementation, and Evaluation). The participants were 30 tenth-grade students from a private high school in Bandung. A student response questionnaire to the media was implemented, which comprised 19 statements (10 positive and nine negative) and was evaluated using a Likert scale. This study implemented Rasch analysis. The result showed that 25 students agreed with the positive statements and disagreed with the negative statements related to interest in learning physics, the use of media, enthusiasm for learning, and usefulness in understanding concepts. Thus, PhyLeM-ReT integrated with the POEAW model facilitates students' comprehension of energy and work material. The developed media can also serve as an alternative for teachers in teaching, specifically enhancing and transforming students' conceptions. This research is crucial in an era where misconceptions regarding physics persist, as it aims to offer effective alternative learning media that can address these obstacles. Additionally, this research presents opportunities for further development in integrating comparable methods into other subject areas of physics that necessitate a profound conceptual approach.

Endoscopic transfacet Decompression for Severe Lumbar Spinal Stenosis: A Technical Note, Illustrative Clinical Series, and Surgeon Survey Regarding Post-Decompression Instability

Background: Lumbar spinal stenosis (LSS) remains a predominant cause of debilitating back and leg pain, affecting many aging populations. Traditional decompression surgeries can be invasive and pose significant risks and recovery time. This study elucidates the techniques and preliminary outcomes of endoscopic transfacet decompression in treating severe LSS. Methods: A retrospective review was performed on 65 patients with severe LSS who underwent endoscopic transfacet decompression. The patient outcomes were analyzed using the VAS for leg pain and the modified Macnab criteria. Pre-operative and post-operative scores were compared, and any complications were analyzed. An online survey was administered to 868 surgeons using Likert-scale ratings to evaluate surgeons’ experience with endoscopic decompression in patients with painful spondylolisthesis. The survey responses were analyzed using descriptive statistics and Polytomous Rasch analysis to evaluate surgeon endorsement. Results: The study included 65 patients, of which 29 (44.6%) were female and 36 (55.4%) were male, with a mean age of 65.79 ranging from 38 to 84 years. The available mean post-operative follow-up period was 31.44 months, ranging from 24 to 39 months. The VAS score for leg pain reduced significantly from pre-operative 7.54 ± 1.67 to 2.20 ± 1.45 by 5.34 ± 2.03 (p < 0.001) with a large effect size (Cohen’s d = 2.626). At the final follow-up, functional Macnab outcomes were reported as excellent by 20 (30.8%), good by 37 (56.9%), fair by 5 (7.7%), and poor by 3 (4.6%) of patients. There were no incidental durotomies, nerve root injuries, wound complications, or instances of post-operative instability. Only five patients (7.7%) developed post-operative dysesthesia. Incomplete decompression led to fair and poor outcomes in 8 (12.3%) patients. No revision surgeries were performed. post-operative instability was not observed. The surgeon survey corroborated these observations, where the polytomous Rasch analysis showed consensus on the effectiveness of the percutaneous endoscopic decompression of low-grade spondylolisthesis. Differential item functioning (DIF) analysis showed no significant bias in item responses between orthopaedic and neurosurgeons. Conclusions: The endoscopic transfacet decompression technique delineated herein showcased excellent Macnab outcomes in managing severe LSS, with a combined success rate of 87.7%. Patients also experienced a statistically significant reduction in leg pain. Dysesthesia rates were lower than with the transforaminal approach, likely because of limited exiting and traversing nerve root manipulation. This technique might represent a viable, less invasive alternative to open microsurgical dissection and decompression for patients with severe LSS, where fusion may be required. This approach was found to be highly accepted among endoscopic spine surgeons.

Revisiting the effectiveness of a performance decision tree-style rubric compared to a grid-style rubric

The performance decision tree (PDT; Fulcher et al., 2011) is a rubric style that is applicable to performance assessment, with origins in Upshur and Turner’s (1995) empirically derived binary-choice, boundary-definition (EBB) scale. It is easier for raters to assess performance by evaluating multiple binary-choice descriptors. Additionally, learners receive easy-to-understand feedback. The most important advantage is that the number of feedback types can be increased to the nth power of 2 (n = number of items). Therefore, this study compared the validity, reliability, and practicality of the PDT and grid-style rubrics. Three Japanese university English instructors participated in the preliminary work to create the rubric, and the contributors scrutinized the information to create a pilot version. Five raters (two English lecturers and three student raters) then scored 64 Japanese university students’ performances in four English-speaking tasks. Next, analyses were conducted using the many-facet Rasch measurement and generalizability theory to observe the validity and reliability of the PDT. The results confirmed that both the PDT and the grid had validity within the range that could be examined and that the reliability was sufficiently high. However, interviews with raters revealed that the PDT had superior practicality. Additionally, the PDT took less time to complete the evaluation than the grid and was judged to be an effective form of the rubric. This article is part of a study aimed at demonstrating the usefulness of the PDT by creating and evaluating a pilot version. It was used to partially examine the validity and reliability of the PDT. The remaining aspects of validation shall be presented in a separate article.

AN EXPLICATION OF HOW WEBSITE DESIGN ACTUALLY SHAPES ONLINE CUSTOMER LOYALTY: INCORPORATING SEM AND PERSON-ITEMS MAP ANALYSIS

This article aims to provide a clear picture of how website/application design equates websites with applications, hereinafter referred to as websites, influences the formation of electronic loyalty (eLoy) through electronic trust (eTrust) and electronic satisfaction (eSat), by providing empirical evidence about the relationship between the demographic aspects of respondents and their choice of response to how the website/app is designed by the company. The research employs a laboratory simulation approach by explicating SEM-based results using the PIM feature within the Rasch model. The verified SEM model demonstrates strong goodness of fit, with six indexes indicating satisfactory results. The findings not only enhance theoretical understanding but also lay the groundwork for future research suggestions, demonstrating the potential for serendipitous discoveries in the evolving landscape of online shopping behavior. Future research should focus on refining the methodology for combining SEM and PIM analysis to further enhance the understanding of online consumer loyalty through website design.