Psychometric Properties Research Articles

Psychometric Validation of the Brief Outcome Survey: A Transdiagnostic Tool for Measurement-Based Care

ABSTRACT Background Measurement-based care (MBC) is a fundamental component of evidence-based psychotherapy that has the potential to improve the landscape of behavioral and mental health (BMH) care for youth and families. Objective The purpose of this study was to assess the reliability, validity, and clinical utility of the Brief Outcome Survey (BOS) when used as part of a comprehensive MBC approach during a course of evidence-based psychotherapy. Method The BOS is a three-item transdiagnostic tool designed to measure the impact of youth’s symptoms/conditions on functioning. Demographic and clinical data were obtained via a retrospective chart review of 75,000+ unique patient encounters over a period of 15 years. Internal consistency, test re-test reliability, construct validity, validity generalization, and clinical utility were assessed. Results Data were analyzed from 8,665 youth (Mage = 11.8 years; 57.2% biological female). The internal consistency coefficient (e.g. Cronbach’s alpha) ranged from 0.80–0.83 (first and second BOS administration). The single measure intraclass correlation coefficient was 0.66 (p < .001). Intraclass correlations between the BOS and the PHQ-9, GAD-7, and CY-BOCS were moderate. No significant differences were found by age. Cronbach’s alphas for the age groups ranged from 0.79–0.82. BOS scores were higher at baseline for biological females compared to males, t(8235) = 2.29, p < .001. Similarly, BOS scores were higher at baseline for youth receiving public versus private health insurance benefits, t(8032) = 2.29, p < .05. A one-way ANOVA revealed significant differences in BOS scores by diagnosis group and Cronbach’s alpha for the BOS was above 0.80 across all five diagnosis groups analyzed. Conclusions The BOS demonstrated evidence of strong psychometric properties and clinical utility, as a session-by-session transdiagnostic MBC tool.

A tale of two constructs: combined assessment of demoralization and subjective incompetence

ABSTRACT Demoralization comprises multiple dimensions. Among them, Subjective Incompetence (SI) is the perception of being incapable of appropriate action in demanding circumstances. SI may be an early sign of demoralization preceding hopelessness, thus we aimed at integrating items related to Subjective Incompetence into the clinical assessment of demoralization. We assessed 414 subjects from the general population with the Demoralization Scale, 24 items (DS24) and the Subjective Incompetence Scale, 12 items (SIS12). We used multiple approaches to detect the optimal number of factors and their item structure, then conducted Bayesian Item Response Theory analyses to study item psychometric properties. Item Response Theory models were used to extrapolate latent severity ratings of clinical dimensions. We modelled the DS24 with five factors (Disheartenment, Sense of Failure, Helplessness, Irritability, Loss of Purpose) and the SIS12 with three (Subjective Incompetence, Inability to plan, Inability to Deal). The more complex IRT model had the best predictive value and helped to identify the items with better discrimination properties across the different dimensions. Twenty items were retained and used to develop the combined Demoralization and Subjective Incompetence Scale (DSIS20), which maintained high correlation with raw and latent trait scores of the longer versions. We combined selected items of the DS24 and the SIS12 to develop the DSIS20, a shorter assessment instrument that includes Subjective Incompetence as well as other clinical dimensions of demoralization. Further study may clarify if DSIS20 may be helpful for the early detection of demoralization.

Living with long-term conditions: validation of a new instrument for family caregivers in a Spanish-speaking population

IntroductionOptimising the management of chronicity has been a global challenge for decades. Individuals with long-term conditions (LTCs) and their families live with them for years. Thus, it is necessary to...

Psychometric Properties of the Scale for Adolescent Physical Deformities

Psychometric Properties of the Scale for Adolescent Physical Deformities

An Examination of the Psychometric Properties of the Exercise Identity Scale and Its Adaptation to Physical Activity

An Examination of the Psychometric Properties of the Exercise Identity Scale and Its Adaptation to Physical Activity

Influence of green practices on user loyalty in sport clubs

The sports industry contributes significantly to environmental degradation through its economic practices. As a result, there has been interest in reducing the impact through various initiatives in sectors such as sporting events, facility management, etc. However, these initiatives have not been studied in the sport sector, eluding the beneficial effects it could have on market positioning and user retention. Therefore, this study aims to assess the effect of green practices implemented by sports clubs on their users’ perceptions and loyalty. The GPSport and EPOD2 questionnaires were used on a total of 1732 users of 27 Spanish sports clubs, of whom 70% were men. In data processing, standard deviation, skewness, and kurtosis were used for psychometric properties; Cronbach’s alpha, AVE, and CR were used for correlations between factors, and CMIN, DF, and CFI were used to test the invariance of the factor structure across user groups. Perceptions of the service were predominantly positive. The construct with the highest value was satisfaction (4.36 ± 0.73), followed by loyalty (4.19 ± 0.79), with green practices scoring the lowest (3.01 ± 0.94). Perceived quality was a significant and direct antecedent of satisfaction, while satisfaction was a significant and direct antecedent of loyalty, with the former relationship being the strongest. Green practices were directly and significantly related to perceived quality, predominantly indirectly related to satisfaction, and mostly directly related to loyalty. For female users, the relevance of green practices as an antecedent of perceived quality and satisfaction was significantly higher. The results obtained suggest that green practices are an added value that improves users’ perceptions, especially among females, justifying the use of marketing strategies based on the adoption of green practices.

Psychometric properties of the Sinhala perceived stress questionnaire (PSQ8-11) in Sri Lankan primary school children

Psychometric properties of the Sinhala perceived stress questionnaire (PSQ8-11) in Sri Lankan primary school children

A systematic review of self-regulation measures in children: Exploring characteristics and psychometric properties

Self-regulation, which encompasses cognitive, behavioural, and emotional domains, poses challenges in consistent measurement due to diverse definitions and conceptual complexities. In recognition of its profound impact on long-term mental health and wellbeing in children, this systematic review examined available self-regulation measures for children and young people between 1 and 18 years of age. The systematic review followed the COSMIN taxonomy and reported on the measurement tools’ characteristics and psychometric properties. The methodology and reporting were guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement and checklist. The protocol for this review was registered with PROSPERO (Number CRD42020155809). A search of six databases (Embase, MEDLINE, PsycINFO, Scopus, CINAHL and ERIC) was performed, and grey literature was searched to identify studies on the psychometric properties of measures assessing all three domains (cognitive, behavioural, and emotional) of self-regulation. The types of psychometric properties were examined against the COSMIN taxonomy of measurement properties. A total of 15,583 studies were identified, and 48 of these met the criteria that reported psychometric properties of 23 self-regulation measures assessing all three domains of self-regulation. Most measures relied on self-reports for ages 11–17, and all had limited psychometric evaluation. The Emotion Regulation Checklist was the most studied measure. Notably, none of the studies evaluated measurement error. The content validity was inadequately evaluated, particularly in terms of comprehensiveness and comprehensibility. Future research should focus on developing measures for young children, evaluating measurement error, and enhancing content validity for comprehensive understanding and effective intervention.

Translation, cross-cultural adaptation and validation of psychometric properties of foot function index in Urdu-speaking population with ankle and foot disorders

BackgroundFoot and ankle problems are frequently prevalent, especially among the elderly, ranging from 70 to 80%. In primary care, foot, and ankle complaints stand out as one of the most frequent reasons for orthopedic consultations. Patient-reported outcome measures are significant in the assessment burden of any condition on the effects of intervention as well as research. The Foot Function Index (FFI) is a region-specific tool that was identified as one of the most commonly used evaluation tools for foot complaints. This study aimed to translate, cross-cultural adapt, and test the psychometric properties of FFI in the Urdu language.MethodologyThe FFI was translated into Urdu language (FFI-U) following Beaton et al. translation guidelines. The data were collected from 230 Urdu-speaking participants with different foot and ankle pathologies. Data collection started after the written informed consent from the participants. All participants completed the FFI-U, Visual Analogue Scale (VAS), SF-36, and the Foot and Ankle Outcome Score (FAOS) at baseline while only 30 participants completed ULFI-U after one week for test-retest reliability. The psychometric properties involved reliability and validity testing. Reliability was assessed where internal consistency was measured using Cronbach’s alpha and test-retest reliability through the intra-class correlation coefficient (ICC). FFI-U was tested for face validity and construct validity (convergent and discriminant). Psychometric criteria were examined against priori hypotheses, and alpha level (p-value < 0.05) was considered statistically significant.ResultsFFI-U demonstrated good reliability with internal consistency (α = 0.86) and test-retest reliability with intra-class correlation coefficient = 0.845 (0.78–0.89). A moderate correlation was found using Pearson correlation between FFI-U total score and physical components of SF-36, VAS (pain, disability), and FAOS (γ= -0.65, 0.72, 0.71, -0.68) respectively, indicating convergent validity however, a weak correlation was found with mental components of SF-36 (γ=-0.25) demonstrating discriminant validity. Face validity was assessed at the pre-final testing stage by interviewing patients. There were no floor and ceiling effects found for FFI-U.ConclusionThe FFI-U has been found reliable, valid, and feasible tool to be used as a patient-reported outcome measure to assess functional levels with different foot and ankle disorders in Urdu speaking population.

Dataset on the Validation and Standardization of the Questionnaire for the Self-Assessment of Service-Learning Experiences in Higher Education (QaSLu)

This dataset shows the original validation and standardization of the Questionnaire for the Self-Assessment of Service-Learning Experiences in Higher Education (QaSLu). The QaSLu is the first instrument to measure university service-learning (USL), validated following a strict qualitative and quantitative process by a sample of experts in USL and generating rating scales for different profiles of professors. The Delphi method was used for the qualitative validation by 16 academic experts, who evaluated the relevance and clarity of the items. After two consultation rounds, 45 items were qualitatively validated, generating the QaSLu-45. Then, 118 instructors from 43 universities took part as the sample in the quantitative validation procedure. Quantitative validation was carried out through goodness-of-fit measures using confirmatory factor analysis and the final configuration optimized using one-factor robust exploratory factor analysis, determining the most optimal version of the questionnaire under the law of parsimony, the QaSLu-27, with only 27 items and better psychometric properties. Finally, rating scales were calculated to compare different profiles of USL professors. These findings offer a valid, strong, and trustworthy instrument. The QaSLu-27 may be helpful for the design of USL experiences, in addition to facilitating the assessment of such programs to enhance teaching and learning processes.

Validation of a dispositional critical thinking scale using an original analytical methodology for addressing data from Google Trends

PurposeA methodological approach is required that complements studies based on surveys, providing a perspective with greater truthfulness and coverage. The study aims to develop a methodology to validate psychological/managerial constructs using data from Google Trends, taking as a case study a critical thinking (CT) scale in organizational domains previously supported by survey data.Design/methodology/approachThe developed methodology consists of eight stages, in which the following is integrated: (1) Internet search interest data (19 Spanish-speaking countries); (2) deductive research processes (e.g. theoretical model, linguistic manifestations, fieldwork, data matrix, analysis statistical, reporting); (3) psychometric properties (e.g. construct validity, criterion validity, reliability) and (4) objective data to examine criterion validity (e.g. unemployment rate).FindingsThe application of the methodology produces evidence that supports the reliability (Cronbach’s alpha, Guttman’s λ4), construct validity (intra-correlations and correlations with reference variables: “entrepreneurship,” “critical thinking,” “soccer,” “beer,” “pornography”) and criterion validity (prediction of unemployment rate) of the CT scale.Research limitations/implicationsThe methodology makes it possible to support or invalidate the quality of construct measurement scales by planning, capturing and processing data available on the internet.Practical implicationsThis manuscript is useful for research in business management (and related areas), which is intensive in the use of psychological/managerial constructs.Originality/valueThe methodology uses a new type of evidence; it is noninvasive, usually more truthful than responses to surveys, and has greater coverage of people participating indirectly in the study.

The Walsh Family Resilience Questionnaire: Validity evidence from Portugal

AbstractBackgroundFamily resilience refers to a family's capacity to face and manage adversities, emerging as a stronger and more resourceful unit. A family system approach enlarges the lens to the broad relational network, identifying potential resources for resilience within the immediate and extended family. This approach emphasizes a family's innate ability to adapt in the face of adversities.ObjectiveThis study aims to test the psychometric properties of the Walsh Family Resilience Questionnaire (WFRQ) using a sample of Portuguese caregivers with children aged between 10 and 15 years.MethodA total of 267 caregivers of children aged 10 to 15 years completed a sociodemographic questionnaire and the WFRQ. Analyses were performed to evaluate the WFRQ's validity evidence based on the internal structure (i.e., dimensionality and reliability) and on its relationship to other variables.ResultsThe findings supported a 31‐item version of the WFRQ with one third‐order latent factor, three second‐order factors, and nine first‐order factors for the Portuguese population. The WFRQ exhibited satisfactory validity evidence based on the internal structure and relation to other variables.ConclusionOverall, the results of this study demonstrate the suitability of the WFRQ as a holistic measure to gauge resilience at the family level, going beyond individual assessments.ImplicationsThis instrument holds significant utility in family resilience research and clinical interventions involving families.

Sleep-related measurements to assess sleep disturbances among people living with dementia in nursing homes: a systematic review.

There is a high prevalence of sleep disturbances among people living with dementia (PLWD) in nursing homes. Reliable and valid measurements are needed to assess these disturbances. The aim of this systematic review was to identify, analyze and synthesize studies of sleep-related measurements to assess sleep disturbances in PLWD. The databases PubMed, CINAHL, and PsycINFO were systematically searched in 2019; the search was updated in March 2024. The inclusion criteria were as follows: participants with dementia or probable dementia in any care setting; and studies that reported at least one of the following aspects: (I) theoretical and conceptual frameworks, (II) user or patient involvement by type of users in measurement development, (III) feasibility and practicability of measurements, and (IV) results of psychometric analyses. The quality of the included studies was evaluated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria and the quality appraisal tool for studies of diagnostic reliability (QAREL) tool. A total of 5169 studies were identified; ultimately, 15 studies describing three self-administered measurements, three proxy-administered measurements and two technological measurements were included. No sleep-related measurement showed acceptable psychometric properties in any of the COSMIN domains. No measurement without adaptation can be recommended for PLWD in nursing homes. If existing measurements are used in clinical practice, the self-perspective of PLWD should be taken into account. If this is no longer fully possible, proxy-rating perspectives in combination could be an option. Future research on sleep-related measurements should be strictly based on international consensus-based psychometric quality criteria.

Development and validation of MyCommunication—Adults, a self‐report communicative participation measure

AbstractBackgroundPeople with communication problems experience challenges in participation. Optimizing communicative participation for this population is an important outcome of speech and language therapy. Participation experiences are best assessed from the patient's perspective, using a patient‐reported outcome measure (PROM). The Communicative Participation Item Bank (CPIB) has been developed to identify perceived problems in communicative participation. However, previous research has shown that the item bank does not cover all domains and concepts of communicative participation, contains general communication items, and is not suitable for all people with communication problems.AimsTo develop a comprehensive PROM aimed at measuring communicative participation for all adults with communication problems and test its content validity.Methods &amp; ProceduresAn initial pool of 242 items was based on three sources: relevant content from an earlier literature review and concept elicitation study, and the translation of the items of the CPIB. This item pool was pilot‐tested for comprehensibility and comprehensiveness using cognitive debriefing interviews in adults with different communication problems (speech, language, voice, hearing and cognitive communication disorders). This resulted in a second version of the item bank. The content validity of this version was tested in a group of professionals. The last (third) version of 133 items was tested for content validity in a second, new group of adults with various communication problems.Outcomes &amp; ResultsThe initial pool of 242 items was developed and pilot‐tested in 27 adults with different communication problems. After modifications, 161 items remained, which were tested in a content validity study with 25 people with different communication problems and five professionals (in the field of speech and language therapy and speech and language research). The professionals considered 91.9% of the item bank relevant and comprehensible, and comprehensive by adding two items. The item bank was then considered relevant, comprehensible and comprehensive by the group of adults with communication problems. A total of 133 items remained in the item bank, related to the International Classification of Functioning, Disability and Health (ICF) Activities and Participation domains ‘mobility’, ‘self‐care’, ‘domestic life’, ‘interpersonal interactions and relationships’, ‘major life areas’ and ‘community, social and civic life’.Conclusions &amp; ImplicationsMyCommunication—Adults is an item bank for measuring communicative participation in adults with communication difficulties. The next step is to test the psychometric properties of the item bank, in order to establish a final item bank. The refined description of the construct of communicative participation can already be used for participation‐focused goal‐setting between individuals with communication problems and speech and language therapists.WHAT THIS PAPER ADDSWhat is already known on the subject The CPIB was developed to measure communicative participation in community‐dwelling adults with communication problems. The item bank does not cover all domains and concepts of communicative participation, contains general communication items and not all questions seem to be relevant for specific target groups (e.g., hearing population).What this paper adds to the existing knowledge This study presents a refined description of the construct of communicative participation and the development of a new comprehensive PROM aimed at measuring this construct for all adults with communication difficulties. The development of the PROM is based on a previously conducted literature review and concept elicitation study. This study describes the development process of this new PROM, called MyCommunication‐Adults, and the assessment of its content validity.What are the potential or actual clinical implications of this work? The refined description of the construct of communicative participation can be used for participation‐focused goal‐setting between individuals with communication problems and speech and language therapists.

Content validity of measures in early numeracy in children up to eight years: A COSMIN systematic review

Early numeracy skills are considered essential predictors for later mathematical and educational achievement. Therefore, there is a need for early numeracy measures with psychometrically sound properties. This systematic review aimed to determine the content validity of all current early numeracy measures in accordance with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) framework and methodological guidelines, and was conducted and reported by following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 statement and checklist. Systematic literature searches were conducted in January 2024 in five electronic databases: CINAHL, Embase, Eric, PsycINFO, and PubMed. Eligible measures assessed numeracy, targeted children up to eight years of age, were published in English in 1995 or later, and had psychometric data on measure dimensionality. Eligible psychometric reports that were published in English described instrument development and/or content validity of included measures. The measures’ methodological quality was assessed using the COSMIN Risk of Bias checklist, after which all three aspects of content validity (i.e., relevance, comprehensiveness and comprehensibility) were evaluated. Six early numeracy measures and eleven psychometric reports were included. None of the measures could be recommended for use in clinical practice, education, or research due to a lack of high-quality evidence on content validity. However, no high-quality evidence was found to indicate insufficient content validity, therefore, all measures still have the potential to be used. Limited access to measures in the domain of early numeracy, despite having contacted both publishers and instrument developers, may have negatively impacted the completeness of the current overview of content validity of early numeracy measures. In line with the COSMIN guidelines, after the initial evaluation of content validity, future studies should evaluate the remaining psychometric properties of the included measures to identify the most robust measures in terms of validity, reliability, and responsiveness.

Multidimensional Self-Regulation Battery for Reading Comprehension: Preliminary Evidence for Criterion Validity

The purpose of this study was to investigate the validity based on relationships with other variables of the Self-Regulation for Reading Comprehension Multidimensional Battery (BAMA-RC). This study was developed quantitatively, with a cross-sectional and correlational design. Participants were 182 middle school students from Brazil. Nine BAMA-RC scales and a Cloze test were used to assess reading comprehension. The data were analyzed using statistics that evaluate relationships between variables (correlation, linear regression, chi-square test, Kruskal-Wallis and Mann-Whitney). The results identified preliminary evidence of criterion validity, confirming the hypotheses of relationships between the dimensions of self-regulation for learning and reading comprehension. These findings encourage new studies to extend the psychometric properties of the BAMA-RC.

Validation in Spanish and English of the Transgender Inclusive Behavior Scale

AbstractThe Transgender Inclusive Behavior Scale (TIBS) seeks to measure transgender-inclusive behavior, specifically actions and language use that support transgender people. The TIBS was developed in the United States. This study aimed to develop a Spanish version of the TIBS and confirm the structure of the English version to explore the psychometric properties and evaluate the construct validity in new contexts. We examined predictors of transgender-inclusive behavior by conducting a comparative analysis between participants from Spain and the United Kingdom. The study involved 1,110 university students, with 545 participants hailing from Spain (375 women, 162 men, and 8 non-binary individuals) and 565 participants from the United Kingdom (368 women, 178 men, and 19 non-binary individuals). Exploratory and confirmatory factor analysis were conducted to investigate and validate the factorial structure of the TIBS. The factor analysis results for the 15 items on the scale confirmed a three-dimensional structure in both languages. The scale score reliability was excellent with a Cronbach’s alpha (α) = .95 in the British sample and with an α = .89 in the Spanish sample. Being a woman, being lesbian, gay, bisexual, trans, queer, intersex, and/or asexual, and being non-religious were the strongest predictors of inclusive behaviors towards transgender people in both countries. The correlations found indicated that people with lower sexual risk behaviors, and lower sexist, homophobic, and transphobic attitudes also presented higher inclusive behaviors towards trans people. These findings support the development of community strategies to increase the social inclusion of transgender people. The TIBS is a useful measure to track their success.

Factor structure and psychometric properties of the Body Perception Questionnaire-Short Form (BPQ-SF); The Persian version.

Body perception is considered an important physiological marker in physical and mental disorders, therefore, its valid and reliable quantification is indeed necessary. Due to the lack of a Persian version of an instrument with validated psychometric properties for evaluating body perception, this study aimed to investigate the factorial structure, reliability, and validity of body perception questionnaire-Short Form (BPQ-SF) among Iranian adults. A total of 748 participants (mean age = 31.74; 57%female) were included in the analysis. Participants were recruited using the online survey method. Confirmatory factor analysis (CFA) was performed and concurrent validity was determined by computing Pearson's correlation coefficient between BPQ_SF, Depression Anxiety Stress Scale (DASS), and somatization subscale of Symptom-Checklist-90 (SOM). Internal consistency (using Cronbach's alpha and McDonald's omega), and composite reliability were also evaluated. The result of the CFA yielded three factors: Body Awareness, Subdiaphragmatic Reactivity, and Supradiaphragmatic Reactivity. Cronbach's alpha values for all BPQ_SF items were 0.94. Moreover, Concurrent validity between BPQ, SOM, and DASS was determined to be between 0.44 to 0.94. and had good internal consistency (McDonald's Omega range: .74-.93 Cronbach's alpha range: .76-.94). The BPQ-SF demonstrated good psychometric properties among Iranians thus can be used to reliably assess body perception.

Adolescent Executive Function Measurements in Indonesia : Systematic Review and Implications in Educational Settings

This study examines the landscape of executive function (EF) assessments for Indonesian adolescents, focusing on their psychometric properties. The adolescent development phase, marked by cognitive growth, presents opportunities and risks, especially in education settings where well-developed EF is beneficial. This research used a qualitative approach, with a systematic literature review method using the PRISMA (Preferred Reporting Items for Systematic Review and Meta-analysis), analyzing peer-reviewed empirical studies from databases such as SCOPUS and others, focusing on EF measurements for adolescents in Indonesia from 2014 to 2024. Nine studies met the inclusion criteria, highlighting tools like the Behavior Rating Inventory of Executive Function (BRIEF)-Indonesian version, Executive Skills Questionnaire-Revised (ESQ-R), Executive Function Questionnaire (EFQ), and performance-based measures like the Wisconsin Card Sorting Test and Stroop Test. Using content analysis, this study reveals that while the BRIEF is widely used in clinical studies, its applicability in educational settings requires improvement. The findings highlight the importance of adapting EF tools with cultural sensitivity and developing new comprehensive assessments with clear psychometric properties regarding all critical EF components. In recommendations, the study pinpoints a multi-method approach combining inventory-based and performance-based measures to provide a thorough understanding of EF while maintaining practicality for educational settings. The implications for advancing EF research and practice in Indonesia, particularly in education, are discussed, emphasizing the need for reliable, valid, culturally sensitive, and accessible assessment tools.

Validation of the Japanese version of Algoplus® for the assessment of acute postoperative pain in older patients with cancer.

This study aimed to validate a Japanese version of the Algoplus® tool by assessing postoperative pain in older Japanese patients with cancer and examining the scale's psychometric properties. After translating Algoplus® into Japanese, we conducted a cross-sectional study of patients aged 65 years or older who underwent surgery to remove malignant tumors. Two registered nurse-certified investigators used the Numerical Rating Scale, the Japanese version of Algoplus®, and the Japanese version of the Abbey Pain Scale before and after analgesic use on postoperative days 3 and 5 to evaluate response to pharmacologic therapy. Validity was tested by a correlation analysis between the Japanese version of Algoplus®, two pain scales, and nine hypotheses related to demographic variables and surgical invasions. The Kuder-Richardson-20 test and Cohen's Kappa coefficient were used for internal consistency and inter-rater reliability, respectively. The total score of the Japanese version of Algoplus® showed strong to moderate correlations with the two pain scales. Demographic characteristics were not associated with the total score of the Japanese version, but significant correlations with operative time and postoperative analgesia administration existed. The scale demonstrated good internal consistency (Kuder-Richardson-20 α: .70) and inter-rater reliability (Kappa coefficient .72). The total score of the Japanese version decreased significantly after analgesic use in both postoperative assessments. The Japanese version of Algoplus® is a reliable and valid instrument for nurses to easily assess acute postoperative pain in older Japanese patients with cancer and shows good responsiveness for detecting the change in pain status.