Tool For Evaluation Research Articles

Addressing the need for Indigenous-specific PROMs and PREMS: A focus on methodology.

Differences in Indigenous worldviews, practices and values highlight the need for Indigenous-specific health quality indicators, such as patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs). The purpose of this paper is to present our methodology, as part of a larger study that sought to develop a framework for creating Indigenous-specific PROMs and PREMs. The research design was informed by Indigenous research methodology and a community-based participatory approach. It had three core components: (1) a literature exploration of existing Indigenous-specific PROMs and PREMs; (2) interviews with researchers with expertise in PROMs and PREMs developed for Indigenous populations and community leaders interested in using these Indigenous-informed evaluation tools; and (3) conversations with Indigenous community members about their experiences with health surveys. Interviews were audio-recorded and transcribed verbatim; transcripts were analyzed qualitatively using an inductive and deductive approach. Themes and sub-themes were identified to build a framework that honours Indigenous knowledges and ways of knowing. Results were validated with select research participants and the Project Advisory Committee. Findings demonstrate how relationship building is the necessary starting point for engagement when developing survey instruments with Indigenous peoples. Engagement requires respectful collaboration through all stages of the project from determining what questions are asked to how the information will be collected, interpreted, and managed. A relational stance requires responsibility to Indigenous communities and peoples that goes beyond research carried out using a western scientific lens. It means ensuring that the project is beneficial to the community and framing questions based on Indigenous knowledge, worldviews, and community involvement. This study employed a collaborative, participatory qualitative approach to develop a framework for creating PROMs and PREMs with Indigenous peoples. The methods described offer concrete examples of strategies that can be employed to support relationship-building and collaboration when developing Indigenous-specific survey instruments.

Development Of Ethnophysics-Based Teaching Materials To Improve The Self-Regulatory Skills Of Prospective Physics Teachers

This development research aims to produce a product in the form of an ethnophysics-based learning tool to improve prospective physics teachers' valid and effective self-regulation. The products developed are Lecture Event Units known as SAP, Student Worksheets or LKM, Teaching Materials, and test instruments. The research design used is a 4D model consisting of Defining, Designing, Developing, and Disseminating. Data collection techniques use validation sheets and evaluation tools. Device validity data was analyzed using a Likert scale. Three expert validators assess product validity. Assessment by validators with valid to very valid criteria. The effectiveness of the teaching materials developed by researchers can be determined by increasing students' self-regulation based on the results of the N-Gain test after being given a pretest and posttest. The planning indicators show that the percentage of students who were suitable/suitable before implementing the ethno-physics learning model was 42%. This indicates that more than 50% of students have self-management related to learning planning that still needs to be improved. Applying the ethno-physics learning model as a stimulus to help students manage good learning planning contributed 36%, increasing to 78%. The monitoring indicator also has the same increase in the number of students as the planning indicator, namely 36%. This can be described as more and more students being able to manage their learning by monitoring their learning process. The evaluation indicator shows the largest percentage increase in the number of students, namely 38%, while it is only 28% for strengthening. This indicates that the ethno-physics learning model has the greatest contribution to stimulating students' evaluation abilities

The pitfalls or gaps in monitoring and evaluation tools during Coronavirus disease 2019 era in South African municipalities

The South African municipalities have continued to demonstrate weaknesses or inadequacies in monitoring and evaluation (M&E). A possible barrier in South African municipalities is a lack of M&E expertise. While M&E can provide valuable insights into the effectiveness and efficiency of a programme, some potential pitfalls and gaps were discovered during coronavirus disease 2019 (COVID-19). A case study design was employed to conduct in-depth and detailed examination within two metropolitan municipalities in the Eastern Cape. A mixed methods approach was adopted in a convergent manner for data collection and analysis. In-depth interviews were utilised to collect data from 13 senior municipal managers at the Nelson Mandela Bay Municipality (NMBM) and the Buffalo City Metropolitan Municipality (BCMM). A total of 191 questionnaires were despatched to municipal employees and 186 were returned, giving a 97% response rate. The findings reflect the weaknesses of M&E policies in the municipalities and paints a picture of M&E not being prioritised in the municipality. The findings also reflect the current situation at the municipalities concerned, which is that there are pitfalls and gaps when it comes to evaluation measures. Thus, the study concludes that accountability for financial and performance management is non-existent. This study attempts to make a valuable contribution by providing technical assistance, capacity building to ensure that municipalities have effective M&E systems in place to monitor and evaluate service delivery and improve the lives of communities.

Metaheuristics Method for Computation Offloading In Mobile Edge Computing: Survey

In recent years, edge computing has emerged as a computing paradigm to support the computationally intensive and latency-critical applications for resource limited devices. The main feature of edge computing is to push computation, networking, and storage facilities closer to the network edge. This enables user equipment (UE) to profit from the edge computing paradigm by mainly offloading their intensive computation tasks to edge resources. Because of some rising problems such as inherent software and hardware heterogeneity, restrictions, dynamism, and stochastic behavior of the ecosystem, the computation offloading issues consider as the essential challenging problems in the MEC environment. However, to the best of the author's knowledge, in spite of its significance, in Metaheuristic -based computation offloading mechanisms, there is not any systematic, comprehensive, and detailed survey in the MEC environment. In this paper, we provide a review on the Metaheuristic -based computation offloading mechanisms in the MEC environment in the form of a classical taxonomy to identify the contemporary mechanisms on this crucial topic and to offer open issues as well. The proposed taxonomy is classified into three main fields: genetic algorithm (GA)-based mechanisms, Partical Swarm Optimization(PSO)-based mechanisms, and Hybrid GA with PSO -based mechanisms. Next, these classes are compared with each other based on the essential features such as performance metrics, case studies, utilized techniques, and evaluation tools, and their advantages and weaknesses are discussed, as well. Finally, open issues and uncovered or inadequately covered future research challenges are argued, and the survey is concluded.

Empowering Seventh-Grade Students with Crossword Puzzle for Vocabulary Mastery

Students often struggle with mastering vocabulary in their English learning journey, necessitating English teachers to seek solutions. One viable strategy teachers can adopt is the integration of crossword puzzles to enhance students’ vocabulary mastery. Specifically, the study sought to determine if providing crossword puzzles to the SMP Negeri 3 Banawa seventh-grade students could enhance their vocabulary proficiency. To measure the impact of this approach, the researcher employed pre-test and post-test assessments as evaluation tools in a quasi-experimental study. Through purposive sampling, the researcher selected two classes, VII B and VII D, each with 29 students, as the study’s sample groups. Subsequently, data analysis revealed a significant disparity between the pre-test and post-test scores in the experimental class. Notably, the computed p-valued (two-tailed) was 0.000, falling below the predetermined significance level of 0.05, signifying the acceptance of the hypothesis. In conclusion, implementing the crossword puzzle in this study led to a noticeable improvement in the vocabulary mastery of seventh-grade students at SMP Negeri 3 Banawa.

PULMOEAST: A Comprehensive Analysis of Pulmonary Hypertension in Eastern India.

Background Pulmonary hypertension (PH) is a debilitating cardiovascular disorder characterized by abnormally elevated blood pressure within the lungs. The diverse range of causes and varied clinical presentations contribute to the complexity of its diagnosis and management. In eastern India and surrounding areas, awareness of PH remains limited, and resources for its management are scarce. This study aims to address this knowledge gap by investigatingclinical characteristics and treatment approaches adopted for PH patients in eastern India. Methods This retrospective-prospective cohort study included patients diagnosed with PH, defined by a pulmonary artery systolic pressure (PASP) > 50 mmHgor amean pulmonary artery pressure (mPAP)>20 mmHg, between July 2015 and October 2023. Data retrieved from hospital records formed the retrospective cohort, while the prospective cohort comprised patients directly recruited for the study. Results The PULMOEAST study enrolled 93 patients with confirmed PH, divided into prospective (59 patients) and retrospective (34 patients) cohorts. The most prevalent cause of PH was congenital heart disease (CHD), with shunt lesions (59.13%), followed by complex CHD (13.97%) and idiopathic PH (20.43%). Six additional patients presented with rare causes of PH, and three experienced transient PH following atrial septal defectdevice closure. Geographic distribution revealed that 72.04% of patients originated from eastern India, while 18.27% hail from other eastern states and 8.6% from neighboring countries. Patients exhibited varying functional classes (FC), with 57 classified as FC-II and 31 classified as FC-III. Treatment strategies primarily involve supportive medications and pulmonary vasodilators. Monotherapy was administered to 26 patients (27.95%), dual therapy to 50 patients (53.76%), and triple therapy to one patient. Notably, 16 patients did not receive any vasodilator therapy as they were waiting for further evaluation. Among the vasodilator regimen, two patients received Selexipag. Three patients underwent intervention for shunt lesion closure, including one patient who received a fenestrated atrial septal occluder implant. Additionally, one patient underwent clot removal for pulmonary thromboembolism. Despite the overall positive response to treatment, the study recorded eight fatalities (8.6%) during the observation period. However, most patients exhibited significant improvement, including a decrease in functional class, during a mean follow-up duration of 14.31 months. Conclusion The PULMOEAST study undertook a comprehensive exploration of PH in eastern India and surrounding regions, revealing a stark dominance of CHD as the primary culprit. The study confirmed the pivotal role of echocardiography as a readily available and effective tool for both initial and follow-up evaluations in resource-scarce settings. It painted a hopeful picture by showcasing significant clinical improvement in most treated patients, with supportive medications and pulmonary vasodilators playing a crucial role. However, the diverse etiologies, limited access to PH-specific resources, and lack of widespread awareness within the region continue to pose substantial challenges for patients. The study underscores the need for refined diagnostic approaches, cost-effective management strategies, collaborative care initiatives, and enhanced patient education to optimize PH care and improve outcomes in eastern India.

Psychometric properties of the Turkish version of the decent work questionnaire and its effect on job satisfaction.

Work to develop a universal tool for the psychological evaluation and measurement of decent work is relatively new. In addition, the Decent Work Questionnaire, which evaluates decent work using a psychological approach, has not yet been adapted and validated in the Turkish sample group. To adapt and validate the Turkish version of the Decent Work Questionnaire and to evaluate the effect of decent work on the job satisfaction among knowledge workers. The study sample consisted of 906 knowledge workers. In the process of adapting and validating the Decent Work Questionnaire, the structural validity, internal consistency, convergent validity, divergent validity, and compatibility of the sample group data were tested. The effect of decent work on job satisfaction of knowledge workers was examined using structural equation modeling. The Decent Work Questionnaire was validated in the Turkish sample. The results showed that the reliability coefficients and dimensions of the Decent Work Questionnaire were highly satisfactory and consistent with the scale developers' study. According to another result of the study, decent work was found to have a significant and positive effect on Turkish knowledge workers' job satisfaction. This study will fill gaps in the literature and will also contribute to the evaluation of decent work in all areas of the labor market, identifying its shortcomings and contributing to the development of effective human resource policies.

Eye Donation Counsellor Skill Evaluation Tool (EDC-SET): A step toward improved eye donation counseling.

The expansion of the Hospital Corneal Retrieval Programme (HCRP) and the role of Eye Donation Counsellors (EDCs) have shown promising results in increasing donor cornea availability. To further enhance EDC competency and improve cornea availability for transplantation, the study proposes the Eye Donation Counsellor Skill Evaluation Tool (EDC-SET). Key words: Competency assessment, corneal blindness, Eye Donation Counsellors (EDCs), eye health, Hospital Corneal Retrieval Programme (HCRP), skill evaluation. A competency framework for EDCs and a tool for evaluation of the competency level (EDC-SET) was designed, along with scripts for emulating realistic counselling scenarios. Independent assessors were trained on using EDC-SET and evaluated EDCs participating in role-plays based on the pre-designed scripts. EDCs were briefed a priori on the EDC-SET but not on the role play scripts which were used during evaluation. We piloted the tool at a tertiary eye hospital, and it was found to capture EDC competency reliably. The study evaluated seven EDCs each assessed by two independent assessors. Conformity, kappa, and intraclass correlation coefficient (ICC) values were calculated to estimate the parameter-wise reliability of the EDC-SET. The results suggest that the scores from both assessors closely matched for most of the parameters, and overall, their ratings showed moderate agreement. The difficulty level of each parameter as assessed by the two assessors was also calculated. It was observed that most participants found "Initiation of the Case" and "Empathy and Emotional Support" challenging. However, "Body Language," "Cultural Awareness," and "Attentiveness to Family Dynamics" were perceived as relatively easy or not difficult by participants. Evaluation of EDCs using EDC-SET revealed the varying competency levels of EDCs and showed agreement on the evaluation between the assessors. Implementing the EDC-SET could help standardise the mapping and measurement of the skill set of EDCs, thereby enhancing their performance and reducing corneal blindness in India.

The use of the Delphi technique as part of the process of developing a tool to evaluate physiotherapy clinical education programmes


 
 
 
 Objectively evaluating the quality and effectiveness of a physiotherapy clinical education programme has been unsuccessful to date, due to its complexity and the lack of a standardised tool. We undertook to develop a standardised programme evaluation tool and used the Delphi method to obtain consensus (set at 80%) to determine the face and content validity of the items and domains of the tool, the scoring system and a name for the tool. Academics, clinical physiotherapists and clinical physiotherapy educators participated in the Delphi rounds. Three Delphi rounds ensued: in Delphi round 1, a 71% response rate was obtained and 49 questions obtained 80% consensus. In Delphi round 2, a 91% response rate was obtained and 59 questions obtained 80% consensus. In Delphi round 3, a 42% response rate was obtained, several names were suggested, and the scoring system was established. The provisional tool of 85 items ultimately emerged as the Vaneshveri Naidoo Clinical Programme Evaluation Tool (VN-CPET).
 
 
 

CTA and CTP for Detecting Distal Medium Vessel Occlusions: A Systematic Review and Meta-analysis.

The optimal imaging method for detecting distal medium vessel occlusions (DMVOs) remains undefined. The objective of this study is to compare the diagnostic performance of CTA with CTP in detecting DMVOs. We searched PubMed, EMBASE, Web of Science Core Collection, and Cochrane Central Register of Controlled Trials up to March 31, 2023 (PROSPERO: CRD42022344006). A total of 12 studies reporting accuracy values of CTA and/or CTP were included, comprising 2607 patients with 479 cases (18.3%) of DMVOs. Pooled sensitivity and specificity of both imaging methods were compared using a random-effects model. Subgroup analyses were performed based on the technique used in CTA (multi or single-phase) and the subtype of DMVOs (M2-only vs. M2 and other DMVOs). We applied Quality Assessment of Diagnostic Accuracy (QUADAS-2) tool and Grading of Recommendations, Assessment, Development and Evaluation (GRADE) quality assessment criteria. CTA demonstrated significantly lower sensitivity compared to CTP in detecting DMVOs [0.74, 95%CI (0.63-0.82) vs. 0.89, 95% CI (0.82-0.93), P < 0.01]. When subgrouped into single-phase and multi-phase CTA, multi-phase CTA exhibited higher sensitivity for DMVO detection than single-phase CTA [0.91, 95%CI (0.85-0.94) vs. 0.64, 95%CI (0.56-0.71), P < .01], while reaching similar levels to CTP. The sensitivity of single-phase CTA substantially decreased when extending from M2 to other non-M2 DMVOs [0.74, 95%CI (0.63-0.83) vs. 0.61, 0.95%CI (0.53-0.68), P = .02]. We identified an overall high risk of bias and low quality of evidence, attributable to the design and reference standards of most studies. Our findings highlight a significantly lower sensitivity of single-phase CTA compared to multi-phase CTA and CTP in diagnosing DMVOs.

A simple tool for evaluation of inflammation in psoriasis: Neutrophil-to-lymphocyte and platelet-to-lymphocyte ratio as markers in psoriasis patients and related murine models of psoriasis-like skin disease

Objective parameters to quantify psoriatic inflammation are needed for interdisciplinary patient care, as well as preclinical experimental models. This study evaluates neutrophil-to-lymphocyte ratio (NLR) and platelet-to-lymphocyte ratio (PLR) in psoriasis patients and five murine models of psoriasis-like skin disease based on topical imiquimod application and overexpression of IL-17A under different promotors. We performed a single-center prospective observational study in a German population, investigating psoriasis patients prior to, 4 weeks, and 16 weeks post begin of systemic anti-inflammatory therapy. Psoriasis area and severity index (PASI), blood count, and C-reactive protein (CRP) levels were attained at each timepoint. Additionally, five murine models of psoriasis-like skin disease involving five distinct experimental procedures differing in time of disease-onset and severity were investigated regarding PLR and NLR. Of 43 recruited psoriasis patients, 34 patients were followed up to 16 weeks. The cohort was 69.77% male, showing a median age of 32.0 years (range 19.0–67.0; IQR 26). The median PASI decreased from 16.35 (8.0–50.0; 10.20) to 1.6 (0–10.3; 2.56) after 16 weeks of systemic therapy. Spearman’s correlation showed statistically significant positive correlation for NLR with PASI (rs = 0.27, p = 0.006), however not for PLR. NLR, but not PLR, was significantly associated with PASI in a multiple linear regression analysis including age, sex, psoriasis arthritis, and smoking. In the murine models of psoriasis-like skin disease, both NLR and PLR were significantly increased in the acute-severe models compared to controls (p < 0.001, p = 0.005, and p = 0.02, respectively), demonstrating gradually less increased values from severe-acute to mild-late-onset psoriatic phenotype. NLR was significantly associated with PASI in psoriatic patients as well as psoriatic phenotype in different murine psoriasis models. Our data warrants investigation of NLR in psoriasis patients and preclinical psoriasis models as an objective biomarker of psoriatic skin inflammation.Key messagesNLR, but not PLR, showed a statistically significant positive correlation with Psoriasis Area and Severity Index (PASI) in our human psoriasis cohort.Both NLR and PLR were significantly increased in murine psoriasis models compared to matched controls, with gradually less increased values from severe-acute to mild-late-onset psoriatic phenotype.NLR may represent an easily available, cheap, and objective parameter to monitor psoriatic inflammation in both clinical patient routine, as well as preclinical experimental murine models.

Evolution of coal permeability during gas/energy storage

Both carbon dioxide and hydrogen can be stored in coal seams as two enabling components of energy transition from fossil-based systems to renewable sources. In both cases, understanding the evolution of coal permeability under the influence of gas adsorption is extremely important. The gas sorption-induced deformation is commonly treated by analogous calculation of thermal expansion. This assumption has long been proved to be inconsistent with observations as reported in the literature. In this study, we hypothesize that the difference between the assumption and the reality is due to self-constrained/facilitated swelling phenomena during gas injection. Under this new hypothesis, coal could be constrained or facilitated depending on coal internal structures and processes. A concept of fictitious stress is introduced to quantify coal self-constrained or facilitated degree and converted into the equivalent effective stress. This conversion has transformed the conventional effective stress principle to unconventional one. This has led to new generic coal permeability model, which has been validated by experimental data. An analysis of stress state evolution during gas storage process is conducted. Our results suggest that our coal permeability model is a valuable tool for evaluation of gas storage in coal seams.

PROMISES AND CHALLENGES OF IMPLEMENTING TELEHEALTH IN LTC FACILITIES: LESSONS FROM A MULTISITE PILOT PROJECT

Abstract In response to the COVID-19 pandemic, the demand for telehealth implementation has expanded in long-term care (LTC) facilities. To better understand the promises and challenges of implementing telehealth, we evaluated a pilot project in which five LTC facilities in California implemented telehealth from September 2021 to May 2022. Employing a mix-method approach, we used a diverse set of evaluation tools (i.e., documenting 37 telehealth visits, holding 8 monthly learning sessions, conducting 36 check-in interviews, and tracking monthly COVID-19 cases) to examine how telehealth was adopted, used, and perceived among residents, administrators, and health practitioners. From a descriptive analysis of quantitative data and a thematic analysis of qualitative data, we found that telehealth demonstrated the capability to treat a variety of conditions; prevented nearly 20% of transfers to emergency departments; residents indicated a high degree of comfort with telehealth; and healthcare practitioners perceived that telehealth could improve care delivery. In addition to benefits, several barriers were identified including initial concerns about the quality of visits, required upfront costs, time constraints, difficulties in coordinating different platforms in the healthcare system, uncertainty about payment parity with in-person care, and reduced staffing related to COVID-19. Based on our evaluation, we propose six strategies to help implement telehealth in LTC facilities: recognize sources of resistance to change; recognize the need for initial investment; understand and address contextual issues; prepare and pave the way for staff buy-in; identify a champion; and ensure sufficient and ongoing training and support.

OLDER ADULTS AND CAREGIVERS AS PARTNERS IN PATIENT- AND FAMILY-CENTERED EDUCATION

Abstract Patient and family-centered education is an approach to the planning, delivery, and evaluation of curricula that is grounded in mutually beneficial partnerships among patients, families, students, and educators. Engaging patients and families in genuine partnerships through health professions education can broaden the student’s perspectives of health to include social, economic, and environmental factors while helping them recognize unique individual dimensions, such as cultural context, capacities, and values, that influence health. While patient-centeredness is a widely recognized component to high-quality healthcare, partnering with older adult patients and caregivers is a less recognized standard in health professions education. This symposium examines the role of older adults and caregivers in co-creating geriatric and gerontology education with a HRSA-funded Geriatric Workforce Enhancement Program (GWEP) to promote the knowledge, skills, and attitudes necessary for patient-centered clinical practice. First, presenters will share educational initiatives involving older adults as mentors and subject matter experts for health professions students and student teams. This is followed by projects engaging and empowering older adults and caregivers as advocates for quality care and advisors for educational improvements. Finally, presenters will explore evaluation tools and strategies to collect input and ensure the patient’s voice remains at the center of education planning, delivery, and improvement. Presenters discuss methods of adapting these models to a local context as well as strategies and opportunities to incorporate the input and feedback from older adults and caregivers into health professions education.

THE HEALTHY BRAIN INITIATIVE ROAD MAP CATALYZES ACTION AMONG STATE, LOCAL, AND NATIONAL PARTNERS

Abstract The Healthy Brain Initiative Road Map Series (Road Map) has achieved measurable success in spurring action in health departments across the country. Evaluation data from the Alzheimer’s Association shows all 50 states have implemented actions from the 2018-2023 Road Map and the majority of states completed at least one action in each of the four domains of the Road Map. The Healthy Brain initiative has also sponsored initiatives to accelerate the implementation of Road Map actions. The projects described are separate from the CDC’s BOLD Program Awards for state and local health departments. The Road Map Strategist Initiative supports local health departments and tribal organizations. It has funded 16 agencies over the past two years to implement Road Map actions in their communities. A coordinated campaign to increase implementation and utilization of the BRFSS caregiving and subjective cognitive decline modules has near nationwide uptake, and, in 2023, a new project, Data for Action, launched in four states to support the use and dissemination of BRFSS and other data. Together, these projects improve assessment, planning and measurement of community health outcomes related to brain health. The 4th edition of the HBI Road Map has an accompanying evaluation tool offering common measures for state and local health departments to track their success as they implement the new actions. This session will explore the past impact of Road Map actions and opportunities for future measurement.

Common domains of nurses’ competencies in public health emergencies: a scoping review

BackgroundA public health emergency can cause large numbers of deaths in a short period, with devastating social, economic and health consequences. Nurses are the main healthcare providers during such emergencies, and their competencies affect the control and outcomes of the situation. Studies on nurses’ competencies in public health emergencies vary between countries and healthcare systems. Therefore, we conducted a scoping review to identify the common domains of nurses’ competencies in public health emergencies worldwide.MethodsWe searched the PubMed, CINHAL, Scopus, Web of Science, Science Direct, Embase, Cochrane Library, WanFang and ECRI databases from their inception to 2023. All published articles on nurses’ competencies in public health emergencies that were published in English and Chinese were included. We mainly analyzed and synthesized nurses’ competencies, assessment instruments and the training described in the included studies.ResultsA total of 27 competency domains were identified following an analysis and summary. The most frequently cited domains were communication skills, self-protection skills, basic knowledge of a public health emergency, laws and ethics and the capacity for organizational collaboration. The Disaster Preparedness Evaluation Tool and the Emergency Preparedness Information Questionnaire were the most commonly used tools for assessing competencies. Most training was conducted online and the content that was covered varied by country.ConclusionsGiven the significant roles and responsibilities of nurses in public health emergencies, knowing the domains of their competencies is essential to evaluating, developing, and conducting clinical training.

BENEFITS AND BARRIERS OF COMMUNITY-ENGAGED RESEARCH AND STRATEGIES FOR STRENGTHENING PARTNERSHIP PRACTICE

Abstract The meaningful engagement of older people in research may help to address their lag behind other groups in health outcomes and low participation in studies. This symposium addresses the critical gap in the aging literature and advances knowledge about community engagement by offering insight from experts on the complexities of partnership and engagement processes that vary by context as well as tools and tactics for overcoming obstacles. The first speaker will present findings and lessons gained from evaluating the needs of a self-organizing community advisory board of Black older adults to increase enrollment in a participant research pool. The second will focus on the challenges of centering a diverse range of partners in the design of a health and wellness program tailored to the needs of formerly incarcerated mid and late-life adults. The third speaker will provide recommendations for researchers interested in working with Indigenous communities and strategies for working collaboratively, and how to overcome relational challenges. The fourth speaker will present findings from a reflective evaluation process of a community-based participatory research partnership that evolved over seven years and discuss how the partnership evaluation tool can enhance partner practice. This symposium concludes with reflections about meaningful and authentic academic-community partnerships in line with supporting and building bridges between aspiring and existing community engaged scholars and older people who are experts on aging.

VALIDATING THE IMPACT OF THE COMPREHENSIVE MOBILITY EVALUATION TOOL USED BY NURSES IN ACUTE CARE

Abstract Existing nursing-based mobility tools were developed with clinical and reliability testing with small samples; none focused on predicting assistance needs. The Comprehensive Mobility Evaluation Tool (CMET) was designed using established testing procedures to support nurses to assess all phases of mobilization and predict level of assistance. A prospective descriptive research design was used to test reliability and validate CMET items, scoring, and ability to predict LOA. A randomly selected sample of decisional/English-speaking non-ventilated stable patients were enrolled from four medical/surgical and one critical care units at a large community hospital where CMET was used. Trained data collectors consented patients, completed bedside testing, and distributed patient surveys. Descriptive, inferential, and regression statistics were used for analysis. The representative sample (N=190) had an average age of 67.3 yrs (SD=16.2, 23-101), 50% male, with a robust range of mobility levels. Inter-rater reliability (n=27) yielded an average kappa of 0.94. Six of seven steps contributed significantly to predicting patient LOA with scores that correlated with nurse judgement [r (184) =0.86, p&amp;lt; .0001]. Patients needed time and support to perform testing without assistance for optimal accuracy and benefit. Patients reported CMET was useful (88%) and easy (62%) and identified barriers that limit walking while hospitalized. Study limited by research at a single site. This study represents the initial validation, confirming reliability and benefits of the CMET, a skill-based tool to evaluate mobility status. Providing time and encouragement to perform CMET helps nurses and patients to identify deficits and tailor care to overcome mobility barriers.

DEVELOPMENT AND TESTING OF THE PC-MET (PERSON-CENTERED MEASURE EVALUATION TOOL)

Abstract Despite the importance of person-centered measurement -- and that numerous research instruments are now available to measure person-centeredness -- there are no tools to evaluate the extent to which existing research instruments themselves are developed consistent with principles of person-centeredness. The PC-MET (Person-Centered Measure Evaluation Tool) was developed to fill that gap. Based on literature and theory, the PC-MET assesses the process of instrument development and the content of the instrument itself based on six overarching criteria of person-centeredness: co-creation, accommodation, incorporation, biopsychosocial-cultural components, pragmatism, and systemic focus. The inter-rater reliability of the PC-MET was evaluated based on instruments recommended for use in relation to the Alzheimer’s Association 2018 Dementia Care Practice Recommendations (DCPR). Independent raters evaluated two measures within each DCPR area using the PC-MET. Agreement was excellent (kappas&amp;gt;0.81) across all PC-MET criteria with the exception of the criteria assessing biopsychosocial-cultural components (where agreement was moderate; kappa=0.42) and pragmatism (where agreement was substantial; kappa=0.68). Raters provided feedback on the PC-MET and agreed or strongly agreed that the tool is easy to understand and score; the six PC-MET criteria are relevant and complete; and the PC-MET could improve the person-centeredness of dementia measurement instruments. The PC-MET has broad potential use, including to critique the extent to which existing instruments are person-centered, to promote efforts to make existing measures more person-centered, and to inform the development of new person-centered measures. This work was supported by the NIA through a grant to the Alzheimer’s Association and by the LINC-AD Research Steering Committee.

Development of a synchronous motion-tracking and video capture tool for flexible ureteroscopy.

Hand/instrument motion-tracking in surgical simulation provides valuable data to improve psychomotor skills and can serve as a formative evaluation tool. Motion analysis has been well-studied in laparoscopic surgery; however, there are essentially no studies looking at motion-tracking for flexible ureteroscopy (fURS ), a common surgical procedure requiring hand dexterity and 3D spatial awareness. We aimed to design a synchronized motion-tracking and video capture system for fURS capable of collecting objective metrics for use in surgical skills training. Motion tracking of the ureteroscope was performed using a motion-tracking platform, inertial measurement units (IMUs), and an optical sensor. Position (x, y, z) and orientation (roll, pitch, yaw) of the ureteroscope handle, lever deflection, and translation of the scope insertion point were collected. Video capture of the operator's hands was collected with a Raspberry Pi camera. All peripherals were controlled on a Raspberry Pi 4 and synchronized to its system clock. Our system demonstrated good accuracy in detecting translation of the ureteroscope in the x- and y-axes, and yaw, pitch and roll of the ureteroscope at discrete orientations of 0, ±30, ±60, and ±90 degrees. Unique to fURS, deflection of the lever was captured by the difference in IMU static accelerations with good accuracy. The optical sensor detected translation of the ureteroscope at the insertion point with good precision and an average error of 5.51%. We successfully developed a motion-tracking and video-capture system capable of collecting motion-analysis parameters unique to fURS . Future studies will focus on establishing the construct validity of this tool.