Coverage Of Items Research Articles

Funding of evidence included within public comments submitted to inform Medicare national coverage determinations.

The Centers for Medicare & Medicaid Services (CMS) relies on public comments submitted in response to proposed national coverage determinations to assist the agency in determining the coverage of items and services for Medicare beneficiaries. In a cross-sectional study, we characterized the cited evidence and what funding supported the cited evidence submitted in public comments to CMS for all therapeutic medical device national coverage determinations finalized between June 2019 and June 2022. Of 681 public comments, 159 (23%) cited at least 1 identifiable published scientific journal article. Within these 159 public comments, 198 unique articles were cited, 170 (86%) of which included funding statements or author disclosures. Among these, 96 (56%) disclosed funding from manufacturers that would benefit from Medicare coverage and/or were written by author(s) who received funding from these manufacturers. In summary, most public commenters for national coverage determinations did not cite published scientific journal articles to support their positions. Among those who did, more than half of articles were directly funded by manufacturers that would benefit from coverage. Greater funding of independent, non-industry-supported research may help provide unbiased evaluations of benefits and harms to support Medicare coverage decisions.

Designing meaningful surveys: Engaging experts-by-lived experience in the development of a patient-reported experience measure (PREM) of integrated home and community care.

Background: People want to live well in their homes and communities for as long as possible. To support this, some home care services in Ontario, Canada are restructuring to integrate medical and personal care, with community-based social care and services (e.g., friendly visiting, meals, and transportation). Measures of client experience, referred to as ‘patient-reported experience measures’ (PREMs) are important for guiding health system improvements in a way that is meaningful to clients. A current challenge is that existing PREMS are insufficient for measuring client experience of new models of home and community care.
 Aims: This study engaged clients, family/friend caregivers, and health and social care providers in a participatory process to develop relevant items for a PREM for integrated home and community care. This engagement process aimed to provide opportunities for client feedback to support integrated care and ensure the new PREM will collect data that can inform health system improvements in ways that are most meaningful to clients and caregivers.
 Methods: Guided by Streiner et al.’s (2015) approach, we engaged experts-by-lived experience in content and face validity testing of an item pool matrix to determine relevance and coverage of domains and items. The matrix consisting of 3 domains, 14 categories, and 72 items was based on a literature review of home and community PREMs (32 PREMs with 550+ items) and interviews with healthcare leader experts (n=6). To conduct content and face validity testing we held three focus groups with home care recipients and family/friend caregivers (n=17) as well as individual interviews with health and social care providers working in home care (n=15). We analyzed transcripts line-by-line to generate themes related to face and content validity of each item. 
 Results: Participants agreed that client experience of innovative home and community care is well captured by three domains: equity, continuity, and life care. They also agreed the corresponding 72 proposed items had face validity. Suggestions to improve content validity included that items be adapted to recognize the role of caregivers; the role of primary providers and/or coordinators in delivering well organized care; and shifting from a focus on self-management to having needed supports to stay in the home, and collaboratively developing care plans. Participants excluded several items due to being vague or not meaningful, such as asking, “my providers understood my needs”. Based on feedback, 22 items were removed from the matrix.
 Learnings: Engaging experts-by-lived experience in development of PREMs helps ensure the data generated from PREMs will be meaningful and useful for guiding health system improvements that matter to clients. Relying on existing literature and traditional expert opinion alone did not guarantee relevance or coverage of items. 
 Next steps: The feedback from participants will be used to further refine and scale the PREM items. Clients of home care and family/friend caregivers will then be re-engaged in cognitive testing to identify issues related to answering the questions on the scale. Once complete, the PREM will undergo psychometric testing.

Development and initial validation of the THL Adverse Childhood Experiences Questionnaire (ACE-THL)

BackgroundThe research on adverse childhood experiences (ACEs) has deepened our understanding of the long-lasting and cumulative effects of childhood adversities. However, the instruments measuring ACEs have several shortcomings, including limited item coverage, collapsing of items and response options, simplistic scoring, and inadequate psychometric assessments. ObjectiveTo design and conduct preliminarily psychometric testing for a brief new self-report instrument—the THL Adverse Childhood Experiences questionnaire (ACE-THL)—with a comprehensive set of clearly formulated items and appropriate response options. MethodsA previously published process model was applied to develop the ACE-THL questionnaire, which was validated by cognitive interviews (N = 20). Interviewers and interviewees completed the questionnaire separately for a cross-informant comparison. In a separate survey panel validation, the respondents filled out the ACE-THL twice, two weeks apart (N = 513, with 426 in the follow-up). Interview data were used to improve item clarity, and test–retest reliability and structural validity were assessed with repeated survey data. ResultsThe final 14-item questionnaire, including 12 ACE items and two items measuring protective experiences, was highly acceptable to the respondents. In the factor analysis of the quantitative data, a sufficiently single-dimensional construct was found, remaining stable in retesting two weeks later. The internal consistency (omega) of the a priori one-dimensional model was 0.89 and 0.90 at baseline and follow-up, respectively. The high test–retest reliability (mean score rank order correlation 0.93) of the ACE-THL indicated that the probed perceptions of childhood experiences are stable. ConclusionBased on the initial validation, the 14-item ACE-THL questionnaire is a reliable and valid instrument to measure adverse childhood experiences, as well as protective experiences.

Validation of item pool for early adolescents’ emotional skills assessment in music therapy

ABSTRACT Introduction Evaluating the validity of the content is an essential step in developing an assessment tool, including an analysis of the quality of the items within the tool. This study describes the content validation of items in the early adolescents’ emotional skills assessment tool in a music therapy context. Methods Content validity was evaluated based on relevance scores provided by two expert panels. Psychometric scores were obtained by calculating item-specific content validity index (I-CVI), scale-specific content validity index (S-CVI) and modified kappa score. In addition, the coverage and understandability of the items were evaluated. Results The validation process identified 60 valid items distributed across six components of emotional skills: expressing, monitoring, identifying, understanding, regulating and the ability to use emotional information. Item I-CVI scores ranged from 0.80 to 1.00, the scale content validity index (S-CVI) was 0.95, the modified kappa score ranged from 0.65 to 1.00, item coverage at scale level was 1.00, and item understandability was 0.92. Discussion The items developed in the study have high validity and are scientifically grounded. The items can be a first step towards a validated assessment tool to evaluate emotional skills in early adolescents. The added value of this study is that the set of items developed is the first to cover all the components of emotional skills identified in the literature. Therefore, music therapists can use the items to observe in more detail the different dimensions of emotional skills in early adolescents.

Exploring aural vocabulary knowledge for TOEIC as a language exit requirement in higher education in Taiwan

Abstract The Test of English for International Communication (TOEIC) is a high-stakes test for students in higher education in Taiwan to fulfill the English-language graduation requirement. However, little is known regarding the vocabulary threshold for the test or the effects of the lexical coverage and profiles of test items on the adequate comprehension of the test. This study used a validated Listening Vocabulary Levels Test (LVLT) and the TOEIC listening subtest to estimate learners’ aural vocabulary knowledge required for an exit TOEIC listening score. The findings showed: (1) aural lexical knowledge accounted for more than half of the variance in comprehension performance; (2) a minimum level of 3,000 word families for a lexical coverage of 98 % considerably affected the comprehension of spoken texts; and (3) lexical profiles varied in the individual parts of the listening subtest, with a range of 3,000–5,000 word families required for achieving a lexical coverage of 98 %. The crucial role of lexical knowledge/coverage in comprehension performance on the exit test was discussed.

알고 있는 표현항목의 텍스트 점유율이 한국어 읽기 이해에 미치는 영향

The purpose of this study is to examine the effect of the text coverage of expression items known to Korean learners on reading comprehension. To this end, 51 foreign students were evaluated for reading comprehension of texts representing the different text coverage of expression items. The target expression items were modified to be meaningless expression items. After the reading comprehension evaluation, interviews were conducted. As a result, as the text coverage of the known expression items decreased, the reading comprehension score of the participants also decreased, but it was confirmed that there was no statistically significant difference. In addition, through the results of the post-interview, it could be assumed that the inference of meaning for the target expression item also affects reading comprehension. Although this study has several limitations, it will be meaningful in that it is an early study that looking at the relationship between the text coverage of expression items and Korean reading comprehension.

Enhancing the Content Validity of Self-Reported Physical Activity Self-Efficacy in Adolescents: A Qualitative Study.

This study's primary purpose was to enhance the content validity of a self-reported measure of self-efficacy for physical activity (PA) in adolescents. This was addressed through assessment of younger and older adolescents' understanding of the construct of self-efficacy for PA, coupled with assessment of the content coverage and comprehensibility of items derived from existing measures. Participants completed individual semistructured and cognitive debriefing interviews as well as 3 PA self-efficacy questionnaires. Thematic analysis identified personal and environmental facilitators and barriers to PA self-efficacy. The major categories were physical; psychological; interaction with surroundings; support and relationships; attitudes; and services, systems, and natural environments. Cognitive interviews resulted in the retention of 52 final items: 24 for self-efficacy with perceived facilitators and 28 for self-efficacy to overcome barriers. This study provides a PA self-efficacy instrument with expanded content coverage that is relevant to adolescents as young as 11 years. With further validation testing in future studies, this instrument will enable pediatric physical therapists and researchers to assess PA self-efficacy and design effective intervention strategies to improve PA.

PROMIS Upper Extremity underperforms psychometrically relative to American Shoulder and Elbow Surgeons score in patients undergoing primary rotator cuff repair.

A number of patient-reported outcome measure (PROM) instruments are used to assess shoulder pain, function, and postoperative satisfaction. Computer adaptive tests (CATs) have been developed in an effort to tailor question delivery, decrease time to completion and floor/ceiling effects, and increase compliance. Previous investigations have demonstrated excellent correlation between Patient-Reported Outcomes Measurement Information System (PROMIS) Upper Extremity CAT (UE-CAT) and American Shoulder and Elbow Surgeons (ASES) instruments, indicating that the PROMIS UE-CAT may be an acceptable alternative to the ASES. Prior to widespread adoption, however, rigorous psychometric validation must be performed. Thus, the purpose of this study was to evaluate the psychometric properties of PROMIS UE-CAT relative to the ASES score in patients undergoing primary rotator cuff repair (RCR). A retrospective study of an institutional RCR registry was performed from July 2018 through March 2019. Preoperative PROMIS UE-CAT and ASES scores were collected. Floor and ceiling effects were determined, and convergent validity was established through Pearson correlations. Rasch partial credit modeling was used for psychometric analysis of the validity of PROMIS UE-CAT and ASES question items, a previously established methodology for assessing shoulder PROMs. Person-item maps were generated to characterize the distribution of question responses along the latent dimension of shoulder disability. Responses from 107 patients (107 shoulders) were included. PROMIS UE-CAT had a strong correlation to ASES (r = 0.684; P < .001), with a 3.7% floor effect and no ceiling effect; ASES had no floor or ceiling effects. PROMIS UE-CAT person-item maps revealed excellent test item coverage between floor and ceiling effects; however, all PROMIS UE-CAT items except "Difficulty putting on a jacket" demonstrated nonsequentially ordered responses, indicating poor reliability of item responses corresponding to shoulder function. Although PROMIS UE-CAT initially demonstrated superior instrument efficiency with fewer test items for overall equivalent coverage of shoulder function assessment, final models after recursive item elimination revealed the ASES instrument to have more well-fitting items over a broader range of shoulder function. Despite its overall strong correlation with ASES and equivalent coverage between floor and ceiling effects, the psychometric properties of PROMIS UE-CAT indicate a need for optimization of individual test items to correspond to shoulder function. Until further refinements in the PROMIS UE-CAT instrument are made, it should not replace the ASES instrument in patients undergoing primary RCR.

Symptoms reported by gastrointestinal stromal tumour (GIST) patients on imatinib treatment: combining questionnaire and forum data

PurposeTreatment with the tyrosine kinase inhibitor (TKI) imatinib in patients with gastrointestinal stromal tumours (GIST) causes symptoms that could negatively impact health-related quality of life (HRQoL). Treatment-related symptoms are usually clinician-reported and little is known about patient reports. We used survey and online patient forum data to investigate (1) prevalence of patient-reported symptoms; (2) coverage of symptoms mentioned on the forum by existing HRQoL questionnaires; and (3) priorities of prevalent symptoms in HRQoL assessment.MethodsIn the cross-sectional population-based survey study, Dutch GIST patients completed items from the EORTC QLQ-C30 and Symptom-Based Questionnaire (SBQ). In the forum study, machine learning algorithms were used to extract TKI side-effects from English messages on an international online forum for GIST patients. Prevalence of symptoms related to imatinib treatment in both sources was calculated and exploratively compared.ResultsFatigue and muscle pain or cramps were reported most frequently. Seven out of 10 most reported symptoms (i.e. fatigue, muscle pain or cramps, facial swelling, joint pain, skin problems, diarrhoea, and oedema) overlapped between the two sources. Alopecia was frequently mentioned on the forum, but not in the survey. Four out of 10 most reported symptoms on the online forum are covered by the EORTC QLQ-C30. The EORTC-SBQ and EORTC Item Library cover 9 and 10 symptoms, respectively.ConclusionThis first overview of patient-reported imatinib-related symptoms from two data sources helps to determine coverage of items in existing questionnaires, and prioritize HRQoL issues. Combining cancer-generic instruments with treatment-specific item lists will improve future HRQoL assessment in care and research in GIST patients using TKI.

A Graph-Based Approach for Mitigating Multi-Sided Exposure Bias in Recommender Systems

Fairness is a critical system-level objective in recommender systems that has been the subject of extensive recent research. A specific form of fairness is supplier exposure fairness, where the objective is to ensure equitable coverage of items across all suppliers in recommendations provided to users. This is especially important in multistakeholder recommendation scenarios where it may be important to optimize utilities not just for the end user but also for other stakeholders such as item sellers or producers who desire a fair representation of their items. This type of supplier fairness is sometimes accomplished by attempting to increase aggregate diversity to mitigate popularity bias and to improve the coverage of long-tail items in recommendations. In this article, we introduce FairMatch, a general graph-based algorithm that works as a post-processing approach after recommendation generation to improve exposure fairness for items and suppliers. The algorithm iteratively adds high-quality items that have low visibility or items from suppliers with low exposure to the users’ final recommendation lists. A comprehensive set of experiments on two datasets and comparison with state-of-the-art baselines show that FairMatch, although it significantly improves exposure fairness and aggregate diversity, maintains an acceptable level of relevance of the recommendations.

The Depression Anxiety Stress Scale 21: Development and Validation of the Depression Anxiety Stress Scale 8-Item in Psychiatric Patients and the General Public for Easier Mental Health Measurement in a Post COVID-19 World.

Despite extensive investigations of the Depression Anxiety Stress Scales-21 (DASS-21) since its development in 1995, its factor structure and other psychometric properties still need to be firmly established, with several calls for revising its item structure. Employing confirmatory factor analysis (CFA), this study examined the factor structure of the DASS-21 and five shortened versions of the DASS-21 among psychiatric patients (N = 168) and the general public (N = 992) during the COVID-19 confinement period in Saudi Arabia. Multigroup CFA, Mann Whitney W test, Spearman’s correlation, and coefficient alpha were used to examine the shortened versions of the DASS-21 (DASS-13, DASS-12, DASS-9 (two versions), and DASS-8) for invariance across age and gender groups, discriminant validity, predictive validity, item coverage, and internal consistency, respectively. Compared with the DASS-21, all three-factor structures of the shortened versions expressed good fit, with the DASS-8 demonstrating the best fit and highest item loadings on the corresponding factors in both samples (χ2(16, 15) = 16.5, 67.0; p = 0.420, 0.001; CFI = 1.000, 0.998; TLI = 0.999, 0.997; RMSEA = 0.013, 0.059, SRMR = 0.0186, 0.0203). The DASS-8 expressed configural, metric, and scalar invariance across age and gender groups. Its internal consistency was comparable to other versions (α = 0.94). Strong positive correlations of the DASS-8 and its subscales with the DASS-21 and its subscales (r = 0.97 to 0.81) suggest adequate item coverage and good predictive validity of this version. The DASS-8 and its subscales distinguished the clinical sample from the general public at the same level of significance expressed by the DASS-21 and other shortened versions, supporting its discriminant validity. Neither the DASS-21 nor the shortened versions distinguished patients diagnosed with depression and anxiety from each other or from other psychiatric conditions. The DASS-8 represents a valid short version of the DASS-21, which may be useful in research and clinical practice for quick identification of individuals with potential psychopathologies. Diagnosing depression/anxiety disorders may be further confirmed in a next step by clinician-facilitated examinations. Brevity of the DASS-21 would save time and effort used for filling the questionnaire and support comprehensive assessments by allowing the inclusion of more measures on test batteries.

Identifying the content for an item bank and computerized adaptive testing system to measure the impact of age-related macular degeneration on health-related quality of life.

We are developing an age-related macular degeneration (AMD) health-related quality of life (HRQoL) item bank, applicable to Western and Asian populations. We report primarily on content generation and refinement, but also compare the HRQoL issues reported in our study with Western studies and current AMD-HRQoL questionnaires. In this cross-sectional, qualitative study of AMD patients attending the Singapore National Eye Centre (May-December 2019), items/domains were generated from: (1) AMD-specific questionnaires; (2) published articles; (3) focus groups/semi-structured interviews with AMD patients (n = 27); and (4) written feedback from retinal experts. Following thematic analysis, items were systematically refined to a minimally representative set and pre-tested using cognitive interviews with 16 AMD patients. Of the 27 patients (mean ± standard deviation age 67.9 ± 7.0; 59.2% male), 18 (66.7%), two (7.4%), and seven (25.9%) had no, early-intermediate, and late/advanced AMD (better eye), respectively. Whilst some HRQoL issues, e.g. activity limitation, mobility, lighting, and concerns were similarly reported by Western patients and covered by other questionnaires, others like anxiety about intravitreal injections, work tasks, and financial dependency were novel. Overall, 462 items within seven independent HRQoL domains were identified: Activity limitation, Lighting, Mobility, Emotional, Concerns, AMD management, and Work. Following item refinement, items were reduced to 219, with 31 items undergoing amendment. Our 7-domain, 219-item AMD-specific HRQoL instrument will undergo psychometric testing and calibration for computerized adaptive testing. The future instrument will enable users to precisely, rapidly, and comprehensively quantify the HRQoL impact of AMD and associated treatments, with item coverage relevant across several populations.

Interplay between upsampling and regularization for provider fairness in recommender systems

Considering the impact of recommendations on item providers is one of the duties of multi-sided recommender systems. Item providers are key stakeholders in online platforms, and their earnings and plans are influenced by the exposure their items receive in recommended lists. Prior work showed that certain minority groups of providers, characterized by a common sensitive attribute (e.g., gender or race), are being disproportionately affected by indirect and unintentional discrimination. Our study in this paper handles a situation where (i) the same provider is associated with multiple items of a list suggested to a user, (ii) an item is created by more than one provider jointly, and (iii) predicted user–item relevance scores are biasedly estimated for items of provider groups. Under this scenario, we assess disparities in relevance, visibility, and exposure, by simulating diverse representations of the minority group in the catalog and the interactions. Based on emerged unfair outcomes, we devise a treatment that combines observation upsampling and loss regularization, while learning user–item relevance scores. Experiments on real-world data demonstrate that our treatment leads to lower disparate relevance. The resulting recommended lists show fairer visibility and exposure, higher minority item coverage, and negligible loss in recommendation utility.

Study on Intensive Care Unit Nutritional Protocol Based on Timing of National Health Insurance Coverage in Taiwan

ObjectivesAggressive nutritional intervention may improve the outcomes of critically ill patients. Therefore, the National Health Insurance Administration (NHIA) in Taiwan revised its relevant fee schedule. On October 1, 2019, nutritional care items for intensive care unit (ICU) patients, covered by the NHIA under the category of nutritional care fees, were introduced to reflect real clinical needs. MethodsThis retrospective cohort study was conducted in a medical center ICU. The study period was January 1, 2019 to May 31, 2020, before and after the start of national health insurance (NHI) coverage of new nutritional care items for ICU patients. A total of 5292 patients were recruited and divided into two groups based on timing of NHI coverage. There were 1591 patients included in the analysis (751 in the non-NHI group and 840 in the NHI group). In the NHI group, the following nutritional protocol was implemented: First visit was at 48hr following admission to the ICU with 2 follow up visits over the next 5 days, then 3 visits the following week. Patient demographics, daily nutritional data, and outcomes were collected to investigate the impact of this protocol. ResultsBoth groups were given the same nutritional intervention initially. However, there were significant differences in nutritional intervention following the incorporation of this treatment protocol in the ICU. Closely monitored nutritional intervention met critical requirements without overfeeding and led to shorter ICU stays (non-NHI 8.11 ± 6.69 days vs NHI 7.12 ± 7.43 days, p < 0.01). ConclusionsNutritional care plan based on frequent assessments and interventions by dietitians is associated with reduced ICU stays for critically ill patients. Funding SourcesNone.

Resolving uncertainties of the factor structures of the Coach-Athlete Relationship Questionnaire (CART-Q)

ABSTRACT Objective: The 3+1Cs model and Coach-Athlete Relationship Questionnaire (CART-Q), measures the interpersonal constructs of Closeness, Commitment, Complementarity and Coorientationto appraise the nature of the relationship, yet the psychometric properties of the instrument still remain unclear. The purpose of this study was to resolve uncertainty about a suitable factor solution through applying previously used analytical methods as well as psychometric methods that are appropriate for this type of response scale, namely asymptotic distribution-free confirmatory factor analysis (CFA) and Rasch analysis. Method: The 11-item direct and meta-perspective versions of the CART-Q were examined utilising AMOS, LISREL and Rach analysis using a sample of 251 national football and futsal coaches and athletes. A model comparison strategy with AMOS provided a direct comparison with previous studies. LISREL and Rasch analysis was conducted to provide additional information about the CART-Q psychometric properties. Results: CFA with maximum likelihood and diagonally-weighted least squares estimation methods supported the factorial validity of the three-factor first-order model of both CART-Q versions, although a unidimensional solution was also tenable. Rasch analysis determined that the unidimensional model possessed higher reliability and provided improved coverage of participants’ scores, minimising ceiling effects. Conclusion: Research designs that require assessment of coach-athlete relationships may prefer the unidimensional model due to its superior psychometric properties. When more detailed profile scores are required, the subscale scores can still be interpreted with adequate validity and reliability KEY POINTS What is already known about the topic: The coach-athlete relationship is essential to enhancing performance and psychosocial well-being. The 3+1Cs model and Coach-Athlete Relationship Questionnaire (CART-Q), represents the most popular approach to understanding coach-athlete relationships. Previous studies investigating the CAR factorial validity have identified the 3+1Cs model as a multidimensional structure with universal applicability across cultures. What this study adds: This is the first study to perform CTT and IRT, to minimise the likelihood of psychometric findings materialising as an artefact of using a particular analytic tool. Contrary to previous research, the results of this study suggest that a unidimensional structure obtained greater robustness in increased reliability, item coverage and reduced ceiling effects than the multidimensionality of the model. These results suggest that a unidimensional factor solution is a more appropriate representation of the model than previously reported and provides researchers with confidence in the psychometric properties of the questionnaires.

Iconicity ratings really do measure iconicity, and they open a new window onto the nature of language

Abstract This paper reviews recent research using participant ratings to measure the iconicity (form-meaning resemblance) of words and signs. This method, by enabling wide coverage of lexical items and cross-linguistic comparison, has revealed systematic patterns in how iconicity is distributed across the vocabularies of different languages. These findings are consistent with established linguistic and psychological theory on iconicity, and they connect iconicity to factors like learning and acquisition, semantics, pragmatic aspects of language like playfulness, and to the semantic neighborhood density of words and signs. After taking stock of this research, we look critically at the construct validity of iconicity ratings, considering an alternative account of iconicity ratings recently put forward by Thompson, Arthur Lewis, Kimi Akita &amp; Youngah Do. 2020a. Iconicity ratings across the Japanese lexicon: A comparative study with English. Linguistics Vanguard 6. 20190088. They propose that, for most vocabulary, participants might rate the iconicity of different words based on their meaning alone – specifically the degree to which it relates to the senses – independently of actual form-meaning resemblance. We argue that their hypothesis cannot account for many of the various, theory-driven results from this line of research, which strongly support the conclusion that the ratings really do measure iconicity.

Measuring Perseverance and Passion in Distance Education Students: Psychometric Properties of the Grit Questionnaire and Associations With Academic Performance

With modern technological advances, distance education has become an increasingly important education delivery medium for, for example, the higher education provided by open universities. Among predictive factors of successful learning in distance education, the effects of non-cognitive skills are less explored. Grit, the dispositional tendency to sustain trait-level passion and long-term goals, has raised much research interest and gained importance for predicting academic achievement. The Grit Questionnaire, measuring Perseverance of Effort and Consistency of Interests, has been shown to be a reliable instrument in traditional university student populations. However, the measurement and predictive validity of this questionnaire is still unknown for adult distance education university students who differ from traditional students in various ways (e.g., having a wider range of student ages). Based on a sample of 2,027 students from a distance education university, this study assessed the psychometric properties of the two-factor structure grit measured by the Grit Questionnaire. The findings suggest that the short form of the Grit Questionnaire is a potentially useful assessment tool for measuring the grit construct for distance learning higher education and that the Consistency of Interests factor is especially relevant to consider the improvement of learning performance for distance education in terms of courses credit and exam attempts. The measurement precision of the Perseverance of Effort factor, however, should be improved in future research to provide higher measurement accuracy and broader item coverage.

Criteria for item selection for a preference-based measure for use in economic evaluation

Preference-based measures allow patients to report their level of health, and the responses are then scored using preference weights from a representative general population sample for use in cost utility analysis. The development process of new preference-based measures should ensure that valid items are selected to reflect the constructs of interest included in the measure and that are suitable for use in preference-elicitation exercises. Existing criteria on patient-reported outcome measures (PROMs) development were reviewed, and additional considerations were taken into account in order to generate criteria to support development of new preference-based measures. Criteria covering 22 different aspects related to item selection for preference-based measures are presented. These include criteria related to how items are phrased to ensure accurate completion, the coverage of items in terms of range of domains as well as focus on current outcomes and whether items are suitable for valuation. The criteria are aimed at supporting the development of new preference-based measures with discussion to ensure that even where there is conflict between criteria, issues have been considered at the item selection stage. This would minimize problems at valuation stage by harmonizing established criteria and expanding lists to reflect the unique characteristics of preference-based measures.

Evaluating popular online English-Chinese dictionaries in China by applying Lew and Szarowska’s (2017) evaluation framework

Abstract By applying Lew and Szarowska’s (2017) evaluation framework and methodology (with a few methodological enhancements made), this study evaluated six popular online English-Chinese dictionaries in China and produced some useful findings. First, Lew and Szarowska’s framework and methodology proved very successful in this study, demonstrating their viability in evaluating online bilingual dictionaries, although a few aspects where enhancements could be made were also identified. Second, the results of the evaluation of the six dictionaries in comparison with those from Lew and Szarowska (2017) suggest that while online dictionaries in the past few years seemed to have made improvements in some areas (e.g. increased coverage of lexical items including neologisms, technical words, and multiword expressions), they appeared to have shown little improvement with problems in some other areas (e.g. inadequate provision of usage, English variety, and part of speech labels and some inappropriate example sentences). Suggestions for addressing the existing problems are provided and implications for future research are discussed.

You Say Tomato, I Say Radish: Can Brief Cognitive Assessments in the U.S. Health Retirement Study Be Harmonized With Its International Partner Studies?

To characterize the extent to which brief cognitive assessments administered in the population-representative U.S. Health and Retirement Study (HRS) and its International Partner Studies can be considered to be measuring a single, unidimensional latent cognitive function construct. Cognitive function assessments were administered in face-to-face interviews in 12 studies in 26 countries (N = 155,690), including the U.S. HRS and selected International Partner Studies. We used the time point of the first cognitive assessment for each study to minimize differential practice effects across studies and documented cognitive test item coverage across studies. Using confirmatory factor analysis models, we estimated single-factor general cognitive function models and bifactor models representing memory-specific and nonmemory-specific cognitive domains for each study. We evaluated model fits and factor loadings across studies. Despite relatively sparse and inconsistent cognitive item coverage across studies, all studies had some cognitive test items in common with other studies. In all studies, the bifactor models with a memory-specific domain fit better than single-factor general cognitive function models. The data fit the models at reasonable thresholds for single-factor models in 6 of the 12 studies and for the bifactor models in all 12 of the 12 studies. The cognitive assessments in the U.S. HRS and its International Partner Studies reflect comparable underlying cognitive constructs. We discuss the assumptions underlying our methods, present alternatives, and future directions for cross-national harmonization of cognitive aging data.