Potential Items Research Articles

Determining the required data elements to develop the information management system for Iranian traditional medicine

BackgroundCurrently, there is no agreed-upon data collection tool for comprehensively structured documentation of Iranian traditional medicine (ITM) from the information management perspective. As ITM practice varies significantly from current medicine in diagnosis and treatment approaches, it is not appropriate to use data platforms or information systems developed for current medicine. Consequently, the collected data are non-comparable, reducing the verdicts’ generalization. Therefore, this research aims to create a minimum data set (MDS) for unified reporting of ITM diseases and interventions.MethodsThis multi-phased method study was performed from December 30, 2022 to March 20, 2023. The first phase involved a literature review, the second phase utilized the Delphi technique, and the third phase focused on validating the MDS-ITM. A list of potential data items was prepared after searching scientific databases, and grey literature, as well as reviewing existing information systems, forms, and websites related to ITM. A modified Delphi technique, including a two-round survey, was then employed. A panel of 34 individuals with clinical and research experience in ITM, was selected via purposeful sampling to rate the importance of candidate data items for inclusion in the ITM-MDS using a 5-point Likert scale. Items with an agreement level of 80% or more were deemed acceptable for inclusion in the final ITM-MDS. Finally, the content validity of the developed MDS was assessed using the content validity ratio (CVR) and content validity index (CVI) criteria.ResultsConsensus was reached on an ITM-MDS containing 291 items grouped into seven categories: Patient admission, past medical history, six principles of health preservation, objective signs, subjective symptoms, examination of body systems, and care plans.ConclusionsThe development of this MDS will enable ITM care settings to exchange information and share resources more easily. It also provides an inclusive dataset and structured documentation of medical records. This MDS can contribute to delivering high-quality care and improving clinical decision-making.

A scoping review of the reporting quality of reviews of commercially and publicly available mobile health apps.

There is no guidance to support the reporting of systematic reviews of mobile health (mhealth) apps (app reviews), so authors attempt to use/modify the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). There is a need for reporting guidance, building on PRISMA where appropriate, tailored to app reviews. The objectives were to describe the reporting quality of published mHealth app reviews, identify the need for, and develop potential candidate items for a reporting guideline. A scoping review following the Joanna Briggs Institute and Arksey and O'Malley approaches. App reviews were identified in January 2024 from SCOPUS, CINAHL, AMED, EMBASE, Medline, PsycINFO, ACM Digital Library, snowballing reference lists, and forward citation searches. Data were extracted into Excel and analyzed using descriptive statistics and content synthesis, using PRISMA items as a framework. One hundred and seventy-one app reviews were identified, published from 2013 to 2024. Protocols were developed for 11% of the reviews, and only 52% reported the geographical location of the app markets. Few reported the duplicate removal process (12%), device and operating system used (30%), or made clear recommendations for the best-rated apps (18%). Nineteen PRISMA items were not reported by most (>85%) reviews, and 4 were modified by >30% of the reviews. Involvement of patient/public contributors (4%) or other stakeholders (11%) was infrequent. Overall, 34 candidate items and 10 subitems were identified to be considered for a new guideline. App reviews were inconsistently reported, and many PRISMA items were not deemed relevant. Consensus work is needed to revise and prioritize the candidate items for a reporting guideline for systematic app reviews.

Cross-Cultural Translation and Adaptation of the Process-Based Assessment Tool (PBAT) to Brazilian Portuguese: A Methodological Approach for Ensuring Linguistic and Cultural Equivalence

Background: Process-Based Therapy (PBT) focuses on understanding and guiding individual change processes, diverging from group-based analyses. The approach tailor’s treatment to address individual issues, emphasizing measurable change processes for effective treatment, while recognizing that effective treatments are not constrained by a specific therapeutic orientation or strategy. The process-based assessment tool (PBAT) was developed to provide researchers and practitioners with a guide to a minimal viable set of process-based items. The PBAT is an item pool designed for intensive longitudinal clinical assessment, developed based on the PBT model. Objective: The present study aims to translate and cross-culturally adapt the PBAT into Brazilian Portuguese. Method: The cross-cultural adaptation process balances literal translation components from one language to the other and an adaptation process that takes into account the culture of the target population. The cross-cultural adaptation process occurred in four major steps: i) translation process; ii) back translation process; iii) evaluation of the semantic equivalence of the preliminary Portuguese version; and iv) pre-test. Result: The analysis of the results from the target population's evaluation was predominantly qualitative, supplemented with indicators such as the Content Validity Index (CVI) to identify potential items requiring adjustments. The results may suggest the effectiveness of the iterative refinement process, potentially increasing confidence in the accuracy and relevance of the translated PBAT for the Portuguese-speaking population. Conclusion: Future research endeavors may benefit from the translated PBAT, enabling a comprehensive exploration of within-person processes and fostering advancements in evidence-based practices.

The sustainable development goals, master plans and the school curriculum: an interdisciplinary scoping review

The Sustainable Development Goals of the United Nations, through the 2030 Agenda, seeks to address the various problems affecting the global population. For this, 17 goals and 162 subgoals were established, agreed by the member countries in 2015 at the COP 21 event in Paris. Therefore, the objective of this Scoping Review was to collect data produced in the world literature, which addressed themes linked to sustainability, education, curriculum, water and basic sanitation, in an integrated way, which dealt more specifically with goals 4 (Quality Education) and 6 (Water and Basic Sanitation) of the UN Sustainable Development Goals. It also aimed to find teaching networks in the most diverse countries, which used the curriculum, to bring the themes proposed by the UN into the classroom. To search for articles published in Portuguese, Spanish, and English, the period from June 2017 to June 2022 was taken into account. In addition, official guiding documents were also investigated. A total of 2,803 potential items were obtained. From this total, around 2,720 were eliminated for not meeting the guiding strings in this research, leaving 83 articles/documents. After further reading, 44 articles/documents met the inclusion and exclusion criteria. Data was found on all continents and in the most diverse countries, with different priorities. The countries that are part of the OECD have worked on these issues intending to improve their indicators. The so-called emerging countries (Brazil, Russia, China, India, South Africa, and Turkey, among others), on the other hand, treat the same data to improve educational metrics and universalize the quality of water supply and sanitation. Finally, in the countries that fall into the peripheral group, the findings were based on a rights guarantee approach, i.e., still from the perspective of implementing and consolidating public policies, such as some Latin American countries, South/Southeast Asia, and the vast majority of sub-Saharan African countries.

Development and validation of a broadly applicable instrument to measure patients' health promotion and empowerment process in chronic disease.

This study aimed to develop and validate a generic, non-disease-specific, self-assessment measure that recognizes patients' health capacities and their empowering process of health promotion in chronic illness by using Bodyknowledging as the theoretical frame. Item generation and expert content validity analysis were the first steps in instrument development. Potential items were then validated in focus group interviews with six patients diagnosed with various chronic diseases. The research team reviewed the resulting items and undertook item reduction. A sample of adults (n = 357) with chronic disease surveyed the instrument items. Exploratory factor analysis with Oblimin rotation was conducted. A 3-factor solution was identified: nine items on the regaining health and wellness subscale, seven items on the uncertainty and bereavement subscale, and eight items on the loss of control and distancing subscale. Cronbach alpha for the scale was .92. The final 24-item instrument is non-disease-specific and broadly applicable for use in health promotion within the context of chronic disease. The instrument demonstrates high internal consistency reliability with initial face and construct validity. The new instrument has the potential for measuring patients' empowering process of health promotion in chronic disease and the outcomes of person-centered interventions and may guide clinicians in tailoring individual support.

Development and Validation of a Novel Tool to Measure Medication Adherence for Noncommunicable Diseases in India: Protocol for an Exploratory Sequential Mixed Methods Multicentric Study.

In high-income countries, only 50% of patients treated for chronic diseases adhere to the prescribed treatment. This issue is even more pronounced in resource-limited countries. Medication adherence scales are simple, low-cost approaches to identify nonadherence in clinical practice. In India, nonadherence to medication varies from 18.7% to 74%, assessed using scales validated in the Western population, as there is no validated medication adherence tool contextualized to the Indian setting. The phrasing of questions in scales validated elsewhere and its interpretations may vary when applied in Indian patients unless accounting for the unique cultural, social, and economic factors influencing medication adherence in India. This could result in inaccurate reports of adherence behavior. This study aims to develop and validate a novel medication adherence tool for select noncommunicable diseases (diabetes mellitus, hypertension, chronic obstructive pulmonary disease, bronchial asthma, and coronary artery disease) in the Indian population. An exploratory sequential mixed methods design will be used, beginning with a qualitative phase where the construct of the scale is defined and preliminary items are generated through a scoping review, focus group discussions, and in-depth interviews. This will be followed by the tool's development phase, including an expert panel review and item revision. Finally, a quantitative phase in 4 zones in India (North, South, East, and West) will be conducted to confirm and validate the newly developed scale. In the first phase, we will frame the construct definition and develop an inventory of potential items for the proposed medication adherence tool. In the second phase, item-level and scale-level content validity indices, along with content validity ratio, will be estimated. In the third phase, we will conduct an item reduction analysis and determine the scoring matrix and item weightage after expert review. We will assess the tool's psychometric properties, plot the receiver operating characteristic (ROC) curve to set an adherence cut-off score, and compute the construct validity and test-retest reliability from the quantitative survey. A medication adherence tool for noncommunicable diseases, developed after ensuring it is ethnically, culturally, and linguistically appropriate incorporating stakeholder perspectives and validated in community settings, would offer a real-world perspective of adherence. The tool will have 2 versions for clinical practice and research, aiding policy makers in adopting tailored adherence policies. PRR1-10.2196/60805.

The Mastocytosis Control Test: A Patient-Reported Outcome Measure Assessing Disease Control

BACKGROUNDMastocytosis is characterized by expanding neoplastic mast cells in organs such as the skin, bone marrow, and gastrointestinal tract. The release of mast cell mediators triggers cutaneous, gastrointestinal, and other symptoms. Currently, no validated mastocytosis-specific patient-reported outcome measure (PROM) exists to assess disease control. OBJECTIVEHere, we developed a disease-specific instrument, the Mastocytosis Control Test (MCT), for evaluating and monitoring disease control in patients with non-advanced disease. METHODSSix potential MCT items were generated using a combined approach consisting of a literature review, patient interviews, and expert input. Item selection and reduction were performed by impact analysis and inter-item correlation, followed by expert reviews and cognitive debriefings. In a validation study, the resulting MCT was tested for validity and reliability by assessing internal consistency, test-retest reliability, convergent validity, known-groups validity, and receiver operating characteristics (ROC) analysis. RESULTSTen patients participated in the item generation phase and 101 in the item reduction and validation phase. The final MCT consisted of five items. Our methods showed a valid total score, high internal consistency, and test-retest reliability. Convergent and known-groups validity demonstrated a strong correlation with related anchors. The ROC curve analysis suggested a cutoff value of ≥13 points to identify patients with good disease control. CONCLUSIONSThe MCT is a disease-specific, valid, and reliable PROM for adult patients with non-advanced disease. It may measure and monitor disease control in routine daily practice and clinical trials.

Development and validation of a questionnaire to measure nurses' perceived knowledge, attitudes and practices related to motor function rehabilitation in stroke patients with hemiplegia.

To develop a questionnaire to measure nurses' perceived knowledge, attitudes, and practices related to motor function rehabilitation in stroke patients with hemiplegia (MFRSPH-PKAP-Q), and to evaluate its reliability and validity. This study was conducted in four phases: (1) creating a pool of potential items; (2) developing the preliminary scale using a Delphi survey; (3) conducting item reduction to refine the scale; and (4) testing the validity and reliability of the final scale. The questionnaire comprises 45 items. Exploratory factor analysis (EFA) revealed a three-factor model, explaining 55.79% of the variance, which encompassed perceived knowledge, attitudes, and practice. Confirmatory factor analysis (CFA) affirmed the suitability of this three-factor model for the data. Additionally, assessments of content validity, convergent validity, and discriminant validity all yielded favorable results. The Cronbach's α coefficient, split-half reliability, and test-retest reliability of the entire questionnaire were .944, .911, and .921, respectively. The MFRSPH-PKAP-Q has been demonstrated to be both valid and reliable, and is therefore recommended for use in clinical practice.

Computational model of a feeding copepod engaged in three modes of movement

Abstract Objectives: Copepods display distinct feeding modes to capture prey in the surrounding water. However, the mechanism and range of prey detection are not fully understood. Methods: Using the method of regularized Stokeslets, we constructed a mathematical model of the flow field around a copepod engaged in three modes of movement: sinking, swimming and hovering. The model assumes that the copepod is negatively buoyant with a simplified body and a pair of long antennae. We then introduced a rigid, neutrally buoyant sphere in the model to predict where potential prey items become detectable in theory. Key Findings: We find that the flow fields around the sinking and swimming models are generally unidirectional, while the flow around a hovering copepod has a significant cross-stream component. Our model shows that the volume of the surrounding fluid that is predicted to be inspected has distinctive shapes that resemble a thin sheet while sinking, a cylinder while swimming and a funnel while hovering. Conclusion: The results suggest that the most efficient mode of feeding depends on the distribution of prey items in the surrounding water.

Developing and Validating the Health Literacy Scale for Migrant Workers: Instrument Development and Validation Study.

Research concerning health literacy among migrant workers in South Korea has been limited, especially given the lack of validated instruments and the lack of focus on the cultural diversity of migrant workers. This study aimed to develop and validate a health literacy scale for unskilled migrant workers (HLS-MW) in South Korea. We first generated a pool of potential items based on a literature review and in-depth interviews with 23 migrant workers. Subsequently, we reviewed empirical referents from the first step to select relevant medical terminologies and passages, ultimately choosing 709 words. The study team initially generated 35 items with 709 health-related terms through empirical referent reviews. After content validity testing by an expert panel, 28 items comprising 89 terms on the 2 subscales of prose and documents were selected for psychometric testing. Overall, 402 unskilled migrant workers in South Korea completed a web-based survey between August and September 2021, with 334 responses included in the final analysis. We used multiple analytic approaches, including exploratory factor analysis, Rasch analysis (item response theory), and descriptive analysis, to examine the new scale's validity and reliability. The final sample primarily included young male workers from South Asian countries. The HLS-MW yielded 2 factors: prose and documents. The item difficulty scores ranged from -1.36 to 2.56. The scale was reduced to 13 items (10 prose and 3 document items), with the final version exhibiting good internal reliability (Kuder-Richardson index=0.88; intraclass correlation coefficient=0.94, 95% CI 0.93-0.95) and test-retest reliability (r=0.74, 95% CI 0.57-0.92). HLS-MW scores differed significantly by Korean language proficiency (F2,331=3.54, P=.004). The HLS-MW is a reliable and valid measure to assess health literacy among migrant workers in South Korea. Further studies are needed to test the psychometric properties of the HLS-MW in diverse migrant groups in South Korea while also establishing cutoffs to help identify those in need of health literacy support.

Development of Digital Health Gender and Sexual Health Literacy scale

Abstract Introduction Health literacy, as the ability to obtain, process and understand health information, including gender and sexuality awareness, appears to be underdeveloped in terms of measurement tools and thematic materials. The literature indicates the existence of serious deficits in gender and sexual health literacy at all levels, with implications for relationships with citizens and patients. Methods Delphi study agreement was conducted and a pool of potential scale items was generated, reflecting a range of skills and abilities within each domain. Items were carefully worded to ensure clarity, cultural sensitivity and relevance to different gender identities and sexual orientations. Expert review and cognitive pre-testing were employed to refine item wording, assess content validity, and ensure that the 10-item scale was comprehensible and relevant to the target population. Results The theoretical development of the 10-item Digital Health Gender and Sexual Health Literacy Scale was successfully completed. The scale items were designed to provide a comprehensive measure of an individual’s ability to navigate the digital landscape for gender and sexual health information. Conclusions The theoretical validation of the Digital Health Gender and Sexual Health Literacy Scale (DiGeSHeL) provides the community with a promising tool to assess individuals’ confidence and ability to use digital technologies for sexual health information and resources. However, further research is needed to validate the scale and test its reliability with a diverse group of participants. Once validated, this scale could be a valuable tool for sexual health promotion programmes to identify gaps and evaluate the impact of digital literacy interventions. Key messages • Gender and sexual literacy are crucial for health. • Health literacy as six vital sign.

CARD-SARC: mixed-method study to develop a disease-specific health-related quality of life tool for cardiac sarcoidosis

Abstract Introduction Sarcoidosis is a rare inflammatory condition caused by the formation of lumps (granulomas) of abnormal tissue in any organ, and can affect physical, functional, mental, social and economic aspects of life. People living with cardiac sarcoidosis (CS) are likely to have worse clinical outcomes and greater impairment on health-related quality of life (HRQoL) than other sarcoidosis manifestations. HRQoL is the main concern for people living with sarcoidosis. However, measuring HRQoL in people with CS is difficult as existing tools focus on other forms of sarcoidosis (for example, lung, eye or skin involvement) or for specific cardiac symptoms (for example, atrial fibrillation, angina or heart failure), but not specifically for CS. Purpose To develop a disease-specific patient-reported outcome measure (CARD-SARC) to assess the impact of CS on HRQoL. Methods A sequential exploratory mixed-method, multicentre observational cohort study using a clinimetric approach was conducted. The McMaster Framework for evaluative instruments involved three steps (item selection, item scaling and item reduction) which were complemented with recommendations from the consensus-based standards for the selection of health measurement instruments (COSMIN). The item-generation process connected data from quantitative (theory, research findings and systematic review) and qualitative components (qualitative semistructured interviews, clinical observations and experts’ opinion). A simultaneous triangulation (QUAN+qual) method was followed to ensure a comprehensive list of preliminary items. The formatting of items was guided by patient and public involvement (PPI) with a 2-weeks recall period. The item reduction strategy was led by PPI and an international multidisciplinary clinical CS-experts. Results 740 potential items were generated by converging all the different sources and techniques. After removal of duplicates and simultaneous triangulation, a preliminary list with 111 items was reviewed by the CS-expert panel with 26 members (including 11 pulmonologists, 7 cardiologists, 5 CS-patients and 3 specialist-nurses). After a consensus meeting, the CARD-SARC included 61 relevant items in six sections for pilot-testing: "functioning", "social, leisure and occupation", "emotional", psychological", "physical" and "healthcare/self-care". Conclusions This study combined a robust methodology with active PPI engagement to develop the first disease-specific HRQoL tool for CS. Each data source was planned independently, however the input from PPI members was critical during the simultaneous triangulation for item-generation. The contributions of CS-experts (members of the PPI group and clinical multidisciplinary experts) enhanced the content validity of the CARD-SARC. The CARD-SARC has the potential to influence clinical management and treatment options, future research and health-economic stakeholders’ decisions for CS.

How to measure the general Environmental Health Literacy

Abstract Background Many environmental factors, both natural or man-made, are associated with health risks. To make informed decisions about these potential risks, certain skills and competencies are necessary. The concept of Environmental Health Literacy (EHL) which integrates aspects of Science Literacy, Health Literacy and Environmental Literacy encompasse these competencies. To assess to what extent individuals or groups are environmental health literate, a general Environmental Health Literacy Scale is necessary. To the best of our knowledge, there is no validated instrument to measure general EHL. Methods Two phases of scale construction were conducted: 1) Item development with deductive methods which includes a literature review and assessment of existing scales resulting in two suitable studies for scale construction. Included items were translated to German language. 2) Scale development with pre-testing of items followed by applying potential items (n = 38) to a sample of of 454 students. Internal consistency (Cronbach’s alpha), Kaiser-Meyer-Olkin Criterion (KMO), Bartlett’s test, Velicer’s minimum average partial (MAP) test for number of underlying factors and Exploratory Factor Analysis using Principal Component Analysis with oblimin rotation and stepwise item reduction were assessed. Results Velicer’s MAP identified 3 factors, Cronbach’s alpha = .92, KMO = .92, Bartlett’s Test revealed significant correlation. Seven items were removed from the scale due to low factor loadings (< .3). Factor 1 (access) explains 18% of variance, factor 2 (knowledge) 12% and factor 3 (reflection) 10%, respectively. Overall, the model explains 40% of variance. Model fit represented by RMSEA index = .05. Conclusions A new general EHL scale has been developed and proven to be suitable for a students sample. This marks the first step towards a validated tool for multiple purposes. Cultural adaptation as well as multiple language validations are in process. Key messages • The process towards a general Environmental Health Scale has started. • The development of a validated EHL scale will improve understanding on whether the general population or subgroups are able to gain, understand and act upon information regarding environmental health.

No evidence hunting bait increases American black bear population growth in Maine, USA

AbstractAmerican black bear (Ursus americanus) populations are increasing throughout much of North America. Use of multiple harvest methods, including hunting over bait, is intended to increase harvest success rates to meet harvest and population management objectives. However, black bear population growth can be influenced by food availability, and some speculate the use of bait may inadvertently increase bear abundance through food resource supplementation. We collected hair from black bears captured from 2005–2019 and a selection of potential food items, including those used as bait from 3 study areas in Maine, USA, with different levels of human influence. We used stable isotope analysis of the black bear hair and food item samples to evaluate the contribution of different identified food groups to the diet of individual bears. We found no evidence that greater contribution of human food resources, including bait, increased the number of cubs per litter for reproductive females or that human foods comprised a greater part of the diet in years when natural food resources were less abundant. Approximately 69% of black bear harvest occurred over bait. We found the probability of reproductive‐age females to be harvested increased with average representation of human foods with high carbon enrichment (including bait) in their diet, but the relationship was weak, likely because of sampling constraints. Additionally, the probability of being harvested was greater in years when natural food resources were scarce. We conclude that bait is not available on the landscape in large enough amounts or for a sufficient amount of time in Maine to substantially influence female reproduction. Our results indicate hunting over bait is an effective tool in a state that is attempting to maintain a stable bear population via harvest, and dispels conjecture that hunting over bait may increase cub production and offset the intention of harvest.

The brief scale of existential loneliness: scale development and psychometric evaluation

Loneliness is a common and distressing experience which has an existential dimension. Existential loneliness is understudied and a brief, valid measure which is grounded in experiences of the phenomenon and captures its distressing nature is needed. This study therefore developed the Brief Scale of Existential Loneliness. Scale items were developed based on a literature review and qualitative inquiry. Potential items were reviewed by academic experts, experts by experience, and potential participants for relevance and clarity. Scale structure was assessed through exploratory and confirmatory factor analysis with 714 participants (17–84 years old, M = 42.25, SD = 20.22) and reliability and validity were investigated. Tests of dimensionality revealed a 6-item unidimensional scale. The scale possesses high internal consistency and construct validity. Consistent with predictions, scale scores are negatively correlated with meaning in life and positively correlated with loneliness (broadly defined), poor mental health, emptiness, and related constructs. The Brief Scale of Existential Loneliness is a short, valid, and reliable measure of existential loneliness which may be usefully employed alongside measures of other loneliness dimensions.

CGCI: Cross-granularity Causal Inference framework for engineering Change Propagation Analysis

In the dynamic landscape of large-scale and intricate product development, the constant generation and accumulation of configuration data, influenced by factors such as evolving demands and version alterations, exhibit inter-domain and inter-level characteristics. This complexity presents formidable challenges to the management of controlled changes. Central to effective change management is Change Propagation Analysis (CPA), particularly in accurately predicting the potential impacts on affected items. However, conventional CPA methods are insufficient for addressing the challenge of cross-domain, cross-level inference. Therefore, we propose a Cross-granularity Causal Inference Framework (CGCI) tailored for CPA. This framework leverages the diffusion and attenuation of influence, enabling efficient identification of potential configuration items. To assess the feasibility of CGCI, a dataset is constructed using raw industrial configuration data and conducted a comprehensive case study on aircraft configuration change control. The results of our comparative analysis show that CGCI is effective in addressing multi-granularity and multi-hop inference problems, with more comprehensive consideration and less inference overhead in the multi-granularity case.

Enhancing Precision in Predicting Magnitude of Differential Item Functioning: An M-DIF Pretrained Model Approach.

Despite numerous studies on the magnitude of differential item functioning (DIF), different DIF detection methods often define effect sizes inconsistently and fail to adequately account for testing conditions. To address these limitations, this study introduces the unified M-DIF model, which defines the magnitude of DIF as the difference in item difficulty parameters between reference and focal groups. The M-DIF model can incorporate various DIF detection methods and test conditions to form a quantitative model. The pretrained approach was employed to leverage a sufficiently representative large sample as the training set and ensure the model's generalizability. Once the pretrained model is constructed, it can be directly applied to new data. Specifically, a training dataset comprising 144 combinations of test conditions and 144,000 potential DIF items, each equipped with 29 statistical metrics, was used. We adopt the XGBoost method for modeling. Results show that, based on root mean square error (RMSE) and BIAS metrics, the M-DIF model outperforms the baseline model in both validation sets: under consistent and inconsistent test conditions. Across all 360 combinations of test conditions (144 consistent and 216 inconsistent with the training set), the M-DIF model demonstrates lower RMSE in 357 cases (99.2%), illustrating its robustness. Finally, we provided an empirical example to showcase the practical feasibility of implementing the M-DIF model.

COVID-19 research response to immediate demands: setting priorities with key stakeholders to enable health services research in NSW, Australia

PurposeCOVID-19 has caused unprecedented disruption to health systems. There is much to be gained by capturing what was learned from changes and adaptations made by health services and systems. The Ministry of Health in New South Wales (NSW), Australia, sought to prioritise health services research (HSR) to address critical issues arising from the COVID-19 pandemic. We tested a priority setting methodology to create priorities for a specific funding opportunity and to extract generalisable lessons.Design/methodology/approachA virtual roundtable meeting of key stakeholders was held in June 2020. We used a modified Nominal Group Technique (NGT) for priority setting, with potential items (n = 35) grouped under headings. Data was analysed through a reflective deliberative process.FindingsWe engaged 89 senior policy makers, health service executives, clinicians and researchers in the roundtable. The NGT proved an efficient method with participants reaching consensus on eight priorities. Findings included strong support for learning from the rapid response to COVID-19 and addressing needs of vulnerable populations and the health workforce. Opinions differed about strategic areas investment and where learnings should be via internal evaluation rather than funded research. Three of the eight recommended priorities were included in the funding opportunity.Research limitations/implicationsCoronavirus disease 2019 (COVID-19) required unprecedented change and adaptations within health systems, and rapid, applied health services research can help to create, understand and (where relevant) sustain change beyond the immediate impact of the pandemic. While final decisions may be dependent on a wider range of considerations by government, stakeholder enthusiasm for engagement in priority setting exercises may be dampened if they do not perceive their application in decision-making.Practical implicationsA modified nominal group technique can be used to set research priorities in constrained conditions by engaging large numbers of stakeholders in rankings and then using an online delivery of a roundtable and to reach consensus on priorities in real time. Recommended priorities for health services research can be readily generated through rapid engagement but does not guarantee their application.Social implicationsAustralia’s swift response to COVID-19 pandemic in 2020 was perceived as a relative success due to the rapid public health and policy response and a relatively low number of cases. This response was underpinned by systematic knowledge mobilisation including support for targeted and prioritised health services research to fill knowledge gaps.Originality/valueSetting priority processes can provide rich, engaged input to support government funding decisions about HSR. A wide range of dynamic and iterative processes influence decision-making in a rapidly evolving situation in the health system response to COVID-19. It is crucial to consider how major investment decisions will support a value-based healthcare system.

Development of a Hospice Perceptions Instrument for Diverse Patients and Families: Establishing Content and Face Validity.

For many, the perception of "hospice" is synonymous with "death." Even clinicians struggle to have conversations that distinguish between hospice and palliative care for fear that discussing hospice may diminish hope. To date, there are no existing measurement tools to evaluate patient and family perceptions of hospice care. This research aimed to develop a Hospice Perceptions Instrument (HPI) to capture these perceptions among diverse patients and families. Building on previous studies and literature, 79 potential items were drafted for the instrument. Our interprofessional team independently and collectively evaluated these, resulting in 36 items rated on a 5-point Likert scale. Overarching domains include (1) hospice philosophy and definitions; (2) hospice services; (3) values; and (4) counter-perceptions. Sixteen national subject matter experts from various professions and roles were invited to participate in the content-validity index and five hospice caregivers were invited to participate in face validity. Fourteen experts responded, with ten meeting inclusion criteria: one physician, four nurses, three social workers, and two chaplains. Six of the ten identified as Black. Three items were removed (I-CVI ranged from 0.5-06), and nine items were revised (I-CVI ranged from 0.6-07). The overall Content Validity Index (CVI) was 0.83, indicating excellent content validity. After revisions, five hospice caregivers assessed face validity and no changes were made based on feedback. Results reveal a disconnect between professional expertise and patient/family voices related to hospice perceptions. Development of this instrument invites a better understanding of perceptions leading to new opportunities for patient/family engagement.

A Reporting Checklist for Discrete Choice Experiments in Health: The DIRECT Checklist.

Reporting standards of discrete choice experiments (DCEs) in health have not kept pace with the growth of this method, with multiple reviews calling for better reporting to improve transparency, assessment of validity and translation. A key missing piece has been the absence of a reporting checklist that details minimum standards of what should be reported, as exists for many other methods used in health economics. This paper reports the development of a reporting checklist for DCEs in health, which involved a scoping review to identify potential items and a Delphi consensus study among 45 DCE experts internationally to select items and guide the wording and structure of the checklist. The Delphi study included a best-worst scaling study for prioritisation. The final checklist is presented along with guidance on how to apply it. This checklist can be used by authors to ensure that sufficient detail of a DCE's methods are reported, providing reviewers and readers with the information they need to assess the quality of the study for themselves. Embedding this reporting checklist into standard practice for health DCEs offers an opportunity to improve consistency of reporting standards, thereby enabling transparency of review and facilitating comparison of studies and their translation into policy and practice.