Professional Assessment Research Articles

Toward the consolidation of a multi-metric-based journal ranking and categorization system for computer science subject areas

The evaluation of scientific journals poses challenges owing to the existence of various impact measures. This is because journal ranking is a multidimensional construct that may not be assessed effectively using a single metric such as an impact factor. A few studies have proposed an ensemble of metrics to prevent the bias induced by an individual metric. In this study, a multi-metric journal ranking method based on the standardized average index (SA index) was adopted to develop an extended standardized average index (ESA index). The ESA index utilizes six metrics: the CiteScore, Source Normalized Impact per Paper (SNIP), SCImago Journal Rank (SJR), Hirsh index (H-index), Eigenfactor Score, and Journal Impact Factor from three well-known databases (Scopus, SCImago Journal & Country Rank, and Web of Science). Experiments were conducted in two computer science subject areas: (1) artificial intelligence and (2) computer vision and pattern recognition. Comparing the results of the multi-metric-based journal ranking system with the SA index, it was demonstrated that the multi-metric ESA index exhibited high correlation with all other indicators and significantly outperformed the SA index. To further evaluate the performance of the model and determine the aggregate impact of bibliometric indices with the ESA index, we employed unsupervised machine learning techniques such as clustering coupled with principal component analysis (PCA) and t-distributed stochastic neighbor embedding (t-SNE). These techniques were utilized to measure the clustering impact of various bibliometric indicators on both the complete set of bibliometric features and the reduced set of features. Furthermore, the results of the ESA index were compared with those of other ranking systems, including the internationally recognized Scopus, SJR, and HEC Journal Recognition System (HJRS) used in Pakistan. These comparisons demonstrated that the multi-metric-based ESA index can serve as a valuable reference for publishers, journal editors, researchers, policymakers, librarians, and practitioners in journal selection, decision making, and professional assessment.

Discussion on Efficacy Evaluation Methods of Nourishing Skin Care Products

Nourishing skin care products play a significant role in the beauty industry as they moisturize, repair, and protect the skin. This article explores various methods for evaluating the efficacy of nourishing skin care products, including clinical trials, chemical analysis, user experience, and professional assessment. By employing a combination of these evaluation methods, consumers and professionals can make informed decisions when selecting the most suitable skin care products. It is important to consider these evaluation methods to ensure the selection of the most appropriate products.

FRAILTY ASSESSMENT FROM PAPER TO ONLINE: THE E-FI-CGA WEB APP

Abstract Background Early frailty assessment is crucial for improving care for older adults through enhancing frailty-informed care planning and execution. To increase the access and use of the established electronic Frailty Index based on the Comprehensive Geriatric Assessment tool, we developed an online software application: the web-based eFI-CGA. Methods End-user requirements primarily adapted the standalone version of the eFI-CGA and covered assessment competency, interface familiarity, accessibility and convenient use by front-line health professionals. Web app-bounded features included user-account authentication and authorization, user-space management, record-search and retrieval, and functions for data management, analysis and display. The web app development used the Microsoft Azure web server with the ASP.NET framework, combined Webforms and Model-View-Controller architecture, and C# programming language with standard client-side libraries incorporating scripting and mark-up languages. Results The web-based eFI-CGA was technically released and accessible online (efi-cga). Tests on the web pages for all the web pages (e.g., Home, Signup Login, Assessment, Search, and Analysis) using large sizes of systematically designed test data and mocked patient cohorts showed that the web software functions meet the requirements with 100% accuracy. Conclusion The web-based eFI-CGA provides a valuable remote frailty assessment and information retrieval method for healthcare professionals, promoting effective multidisciplinary integrated care of older adults. Further work is needed to allow the safe use of the web app. We are also planning a patient-oriented frailty assessment tool for community-dwelling older adults.

IMPLICATIONS OF RESIDENT AND ENVIRONMENTAL CHARACTERISTICS ON RESIDENT-TO-RESIDENT AGGRESSION

Abstract This study examines factors associated with resident-to-resident aggression (RRA) in long term care facilities in Hong Kong. A total of 800 personal care worker participated. Participants averaged 42.03 years of age (SD=7.63), were mostly female (92.7%), married (79.1%) and reported an average of 6.28 years of experience in long term care. 96.9 percent of the participants provided care to residents with dementia but 58.9% considered the training they received insufficient. RRA was common: All participants reported having witnessed verbal aggression (100%), 18% disruptive behaviors, 11.8% physical violence, and 3.1% sexual aggression. The following analysis used a subset of 412 participant from 29 long term care facilities where environmental assessments were conducted. General linear model analysis showed that RRA was associated with both resident and environmental characteristics. Victims’ neuropsychiatry symptoms, perpetrator male gender and neuropsychiatric symptoms were associated with higher RRA. Separation of residents with and without dementia, inappropriate use of nursing unit for residents as measured by Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH), lack of functional and attractiveness courtyard, less cleanliness of spaces, insufficient lighting and insufficient orientation / cueing as measured by Professional Environmental Assessment Procedure (PEAP) were also associated with higher RRA. There is an urgent need to prevent and intervene RRA in long term care facilities. Improving management of neuropsychiatric symptoms and creating a supportive and accommodating environment could be helpful in this regard.

Exploring Factors Shaping Primary Health Care Readiness to Respond to Family Violence: Findings from a Rapid Evidence Assessment

Abstract Purpose Family violence (FV) is defined as any situation where an individual employs abusive behaviour to control and/or harm a former or current spouse, non-marital partner, or a member of their family. The health consequences of FV are vast, including a wide range of physical and mental health conditions for individuals experiencing violence or survivors, perpetrators, and their children. Primary health care (PHC) is recognized as a setting uniquely positioned to identify the risk and protective factors for FV, being an entry point into the health care system and a first, or only, point of contact for families with professionals who can facilitate access to specialist care and support. Methods A rapid evidence assessment of empirical studies on FV interventions in PHC was conducted to examine outcomes of effective FV interventions that promote identification, assessment, and care delivery within diverse PHC settings, factors shaping PHC provider and system readiness, and key intervention components that are important for sustaining PHC responses to FV. After completing data extraction, quality appraisal, and a hand search, a total of 49 articles were included in data synthesis and analysis. Results Several FV interventions that include multiple components such as, screening and identification of FV, training of PHC providers, advocacy, and referrals to supports, have been rigorously tested and evaluated in diverse PHC settings in rural and urban areas including primary care/family medicine practice clinics and community PHC centers. These interventions have demonstrated to be effective in identifying and responding to violence primarily experienced by women. There is a dearth of FV interventions or programs from empirical studies focused on men, children, and perpetrators. Additionally, provider and system readiness measurement tools and models have been implemented and evaluated in PHC specifically to assess physician or the health care team’s readiness to manage FV in terms of knowledge and awareness of FV. The findings highlight that there is no clear or standardized definition of provider or system “readiness” in the literature related to FV responses in PHC. Further, the findings revealed four key intervention components to facilitate PHC provider and organization readiness to address FV: (1) multidisciplinary teamwork and collaboration, (2) improving provider knowledge on the social and cultural determinants impacting FV, and (3) embedding system-level supports within PHC. Conclusions FV is a serious public health concern and PHC providers have a vital role in early detection of FV and the poor health outcomes associated with violence A focus on comprehensive or multi-component FV interventions are more likely to change provider behavior, and would allow for safe, confident, and professional identification and assessment of FV within PHC.

Criteria for assessing interpretation from the textual and speech aspects perspectives

The comparative analysis of a range of interpretation assessment scales and criteria that focus on textual, speech and behavioural aspects has helped identify the core area of interpretation assessment criteria, which includes the parameters concerned with the faithfulness of meaning transfer and the quality of target language production, as well as phonologic aspects of interpreter speech, including prosody, the latter two subsumed under the rubric “Delivery” in the aforementioned scales and sets of criteria. Two professional interpreter performance assessment scales have been analyzed from the point of view of the criteria of assessment presented therein. Various other interpretation assessment instruments were further studied to identify the core area of interpretation assessment criteria − the criteria found across the selection of the assessment instruments − and the variable area − those that are found in some of the assessment instruments included in this study. As shown by our comparative analysis, apart from the criteria relating to meaning transfer, target language quality, and phonology that form the core area of interpretation assessment criteria, this area also includes the parameters concerned with such phenomena as vocalized pauses, backtracking, self-corrections, repetitions, and false starts, the status of which within the area of interpretation assessment has not been fully defined. We propose that these core criteria be understood as breakdowns in the implementation of the speech programme. Aspects of an interpreter’s behaviour (kinesthetics, proxemics) that also come under the rubric “Delivery” in interpretation assessment criteria, however, form the variable zone alongside the parameters related to an interpreter’s unconscious mechanical behaviour.

Development and psychometric testing of the Professional Interpersonal Competency Assessment Scale for Novice nurses (PICASN).

Assessing the professional interpersonal competency of novice nurses is crucial for preventing staff turnover and promoting effective work. However, none of the instruments identified in the literature specifically target novice nurses. This study aimed to develop and psychometrically test the perception dimension of the Professional Interpersonal Competency Assessment Scale for Novice nurses (PICASN) in Japan. The study comprised four steps: 1) concept identification, 2) item construction, 3) validity measure, and 4) reliability measure. A cross-sectional web-based questionnaire was administered from February to April 2023 and was completed by 203 novice nurses. Data quality was assessed using mean, item response, missing values, floor and ceiling effects, internal consistency, and item-rest correlations. Content validity index (CVI) was used to determine the instrument's validity, while exploratory factor analysis (EFA) using maximum likelihood estimation with Promax rotation was employed to assess the factor structure. Cronbach's alpha was used to evaluate reliability. The 27-item PICASN demonstrated an Item-CVI of 0.94 and a Scale-CVI of 0.88. EFA revealed two factors: 1) Basic competencies as a novice nurse (15 items) and 2) Relationship building skills within the healthcare team (12 items), which explained 80% of the variance. Internal consistency reliability was excellent at 0.94 and 0.91 for the factors, and the overall scale reliability was 0.95. The item-rest (I-R) correlation values exceeding 0.6 were considered acceptable. The PICASN demonstrates satisfactory psychometric properties, making it an effective tool for measuring professional interpersonal competency among novice nurses in Japan. This instrument serves to assist novice nurses by promoting self-awareness and offering targeted insights into specific areas requiring improvement. Additionally, it provides experienced nurses and nurse managers with valuable insights into team dynamics, guiding interventions for continuous quality improvement.

Translanguaging in the Saudi EMI Classroom: When University Instructors Talk

The past few decades have witnessed a growing interest in using English as a Medium of Instruction (EMI), especially in higher education. Although the English language has rapidly shifted from being taught as a foreign language to becoming a medium of instruction, empirical research in this area is still limited in the context of the Middle East and North Africa (MENA), especially in Saudi Arabia. Therefore, the present case study explores translanguaging in the EMI classroom. The study used semi-structured interviews to investigate teachers’ perceptions and practices regarding translanguaging, the rationale behind such practices, and the pedagogical effect of implementing translanguaging practices. The data was collected from five university professors majoring in medicine, physics, electrical engineering, and computer science using purposive sampling. It was analyzed using thematic qualitative analysis. The findings show that the participants generally have a positive attitude toward translanguaging, as it was triggered by students’ limited language proficiency and the contextual and psychological situation of the students in the classroom. The results also indicate that it facilitates content comprehension and aids in raising student engagement and reducing language anxiety. Consequently, adopting translanguaging strategies in EMI classrooms with caution is recommended to provide a wealth of advantages and chances for students’ linguistic growth, engagement, and academic success. Professional development programs and assessments of students’ needs are necessary to ensure the prudent use of translanguaging in class and improve EMI classrooms.

Gastroenterology services for patients with Cystic Fibrosis across Australia and New Zealand: a multi-stakeholder assessment of patients' and professionals' perspectives.

Gastrointestinal (GI) symptoms are common in individuals with Cystic Fibrosis (CF). International research has highlighted that GI care for this group of patients is lacking. Gastroenterology services to CF clinics across Australasia are yet to be examined. This study aimed to describe the current service delivery model and identify areas for improvement that may lead to positive patient outcomes. CF clinicians (dietitians, clinical nurse consultants, respiratory consultants), gastroenterologists (GE), and patients or their carers from Australia and New Zealand (NZ) were surveyed online to gather their opinions on CF gastroenterology services provided in their region. Data were analysed using descriptive statistics (frequencies and percentages). Likert scale questions were analysed by grouping responses 1-5 and 6-10, presented alongside the median and interquartile range (IQR). Mann-Whitney U and chi-square tests were used to look at differences between stakeholder groups. One hundred and fifty-six health professionals and 172 patients or their carers completed the survey. Results showed that the current GI model of care is predominantly a publicly funded service delivered outside of CF clinic time. GE are largely not integrated into the CF team and report a lack of training opportunities. There is a higher level of dissatisfaction with the current service model in NZ than Australia. No stakeholder group deemed the current CF gastroenterology service model as adequate, leaving opportunity for transformations in this field. Ideally this study will invigorate the need for promotion and integration of GI services that would ultimately benefit the whole CF community.

The situation of professional integration of young people and adults with disabilities through the supported employment system

The general purpose of this research is to assess the level of social and professional integration of a sample of graduates with disabilities coming from the School Center for Inclusive Education "Albatros" Constanta who benefit from supported employment. In this regard, with the support of the school management, former principals, the two teachers-psycho-pedagogues and the social worker, we started identifying and collecting this information using as working methods and techniques: biographical method (anamnesis and catamnesis), analysis of school and archival documents, conversation and survey method based on the questionnaire technique (Social and Professional Integration Assessment Questionnaire - ISP) and administered a scale from a questionnaire of personality that measures the facet "happiness".

Teachers’ teaching and professional competences assessment

This research is part of a project led by the Catholic University of Santiago de Guayaquil (Ecuador) and the National Distance Education University - UNED (Spain) aiming at designing a teaching/professional competences training model for teachers. The purpose of this study is to assess the meaning of professional competences and their significance within teachers’ teaching and training processes. Using the mixed methods approach, an ad hoc questionnaire was designed and given to discussion groups, achieving participation of more than a hundred teachers. Quantitative data analysis was carried out using the Logit model while Atlas ti 23 allowed analysis of the qualitative data. The results evidenced high scores in the competences evaluated, being leadership and research the lowest. In general, the teachers value, preferably, planning, communication, evaluation, methodology, digital, and tutoring competences, with a lower value among teachers ranging from 25 to 30 years old; those older than 55 stressed the importance of digital and innovation competences. Thus, it is recommended that training programs for teachers should focus on the set of related competences, especially on the digital competence, considering the challenges represented by investigation and pedagogical leadership.

Heuristic evaluation and usability testing of a functional dementia stages app for Hispanic family caregivers

AbstractBackgroundHispanic family caregivers of persons with Alzheimer’s disease and other dementias are not getting the anticipatory guidance they need about how functional abilities will change as dementia progresses. Existing informational resources are overwhelming to navigate and written at a high reading level. Furthermore, professional assessment of functional abilities is not universally available. Innovative, tailored approaches are needed. Our aim was to develop and test a mobile application, the Interactive Functional Assessment Staging Navigator (I‐FASTN), to support Hispanic family caregivers’ assessment of care recipients’ functional stage of dementia in either English or Spanish.MethodWe conducted heuristic evaluation with informatics experts (N = 5, English only) and usability testing with caregivers (n = 10 English, n = 10 Spanish). Participants attempted a series of tasks with the app using a think‐aloud protocol and then rate the usability of the app using mobile app heuristics (experts) and two usability instruments (caregivers). Sessions were recorded and transcribed. For heuristic evaluation, we tabulated the number of usability problems by category: cosmetic, minor, major, and catastrophic. For usability testing, recordings, notes, and transcripts were content analyzed to extract usability problems, suggestions for improvement, desired app features, and other feedback.ResultRefinements to the app were made after each of the five evaluations to address the problems encountered. Caregivers’ mean usability scores were high (4.6 and 4.7 out of 5.0), reflecting good usability overall. Chief usability problems were a confusing tutorial and difficulty finding the app’s side menu. These will be addressed by creating a video tutorial and moving all menu items to the home screen. The app was very well received by caregivers, who indicated that the concise, illustrated content met their informational needs. However, analog alternatives are still needed by caregivers unaccustomed to using apps as they had difficulty moving on from even the simplest screens (see Figure 1a).ConclusionCaregivers are not receiving informational support in a way that meets their needs. The focus should be on providing concise information that addresses the practical aspects of caregiving, tailored to the care recipient’s functional stage.

The corporate social assessment: making public purpose pay

Corporations can be powerful engines of economic prosperity, but also for the public good more broadly conceived. But they need to be properly incentivized to fulfil these missions. We propose an innovative plan called the Corporate Social Assessment (CSA). Every four years, a randomly selected Citizens’ Assembly will meet to decide a grading scheme for assessing companies’ conduct. At the end of the cycle, a professional assessment body will grade the companies and rank them. The ranking will be the basis for subsidies to higher-tier companies, to be paid out of a fund to which all companies will contribute, to create a race to the top which financially rewards corporations taking public concerns seriously. The CSA radicalizes the corporate license to operate. To retain legitimacy in the eyes of wider segments of society, the proposal aims to democratize the way we hold corporations accountable for the power they wield.

Assessing the Quality of Health Content on Arabic Digital Platforms: Insights from Healthcare Professionals and the Public

Fundamentally, human well-being serves as the bedrock upon which individuals can lead enriching lives and contribute positively to their communities and the global society. Most industries across the board employ social media to disseminate their offerings and facilitate customer engagement. This has also found its way into the healthcare sector, with numerous websites and social media platforms. These platforms host a wealth of health-related information and empower the public to seek out health insights that pique their interest. Given the vital nature of the healthcare sector, it becomes imperative to disseminate health information with censorship and ensure continuous monitoring and updates.
 This study endeavors to explore the assessment of healthcare sector professionals, encompassing doctors, medical students, nurses, and other healthcare professionals. Additionally, it seeks to gauge the opinions of the public who frequent these online platforms. The evaluation was conducted based on various criteria derived from prior research, employing a questionnaire methodology to gather the necessary feedback. The outcomes of the evaluation yielded positive results in both participant categories. However, it is important to acknowledge that this evaluation does not include all healthcare platforms or all inquiries. This underscores the urgent need to establish controls, as stated in the study's concluding observations.

Competencies of Medical Education Instructors In Simulation-based Education: a Descriptive Phenomenological Study

Introduction: Simulation-based training is a method of creating an educational experience without being present in a real environment. Recently, this method has become a priority in medical education, particularly in the context of patient safety. It is important to address the competencies of instructors in simulation-based education alongside the advantages and limitations of this method. Therefore, the aim of this study is to identify the components of competency for medical education instructors in simulation-based training. Methods:This qualitative study was phenomenology. Semi-structured interviews with 8 Purposive sample of medical education instructors was conducted (from 23 October 2022 to 20 February 2023). Interviews were analyzed using the seven-step Colaizzi method. Then the identified concepts were coded using MAXQDA software. Results: 115 primary codes, 18 sub-themes and 4 main themes were identified, including: personal competence (self-directed learning and teacher's attitude), professional knowledge competence (professional development and instructional design), professional skill competence (participation, collaborate and purposeful use of simulation) and assessment competence (Assessment and continuous improvement). Conclusion: Medical education instructors need to be empowered for using simulation-based education. The indicators identified in this research can be used to improving the competences of them.

Position Statement: Range Orders in the Management of Pain

American Society for Pain Management Nursing (ASPMN) supports safe medication practices and the appropriate use of pro re nata (PRN) range orders for analgesics in the management of pain within the scope of nursing practice. Although range orders may apply to many medications prescribed as PRN, the focus of this ASPMN position statement is on PRN analgesic medication. PRN range orders are commonly used to provide flexibility in dosing to meet the analgesic requirements of an individual patient. There are many patient-specific factors that require professional clinical assessment when administering medications to patients. Unfortunately, several myths persist regarding The Joint Commission's (TJC) standard around the implementation of range orders leading many to assume that range orders are not supported or safe. On the contrary, if utilized in a consistent and appropriate manner, PRN range orders can allow nurses to provide optimal pain management while still providing safe administration (Paquette et al., 2022).

Reliability Evaluation of Professional Assessments

All professional technical assessment processes are fraught with uncertainty. If a decision is premised upon the result, the decision maker must understand the reliability of the performed assessment. A causal theory application is developed utilizing distinct (linguistic, ordered) terms and continuous (numerical) variables. It uncouples the methods from the result of the assessment obtained and focuses on those aspects that are important to the reliability assessment of the conclusion, not the answer itself. Matrices provide a means of characterizing the uncertainty of the methods and information available for each principal issue impacting the reliability. These matrices are determined as paired qualitative assessments of the Quality of the Measures Used and the Quality of Implementation of component description measures. Each is qualified by two to five grades, allowing three, five, seven, or nine quality distinctions for the assessed element. Uncertainty β values are determined for each component of the assessment combined by either an RMS procedure or a weighted average and converting a numerical value back to a consistent linguistic term. This procedure yields a basis for using good judgment while being sensible and reasonably cautious by independently determining the reliability using a carefully considered approach. California State University has assessed seismic retrofit priorities for 56 buildings using this method and has committed to its continuing use as its retrofit priority evaluation tool.

The long-term effect of modulated acoustic stimulation on alteration in EEG brain network of chronic tinnitus patients: An exploratory study

Acoustic stimulation is one of the most influential techniques for distressing tinnitus, while how it functions to reverse neural changes associated with tinnitus remains undisclosed. In this study, our objective is to investigate alterations in brain networks to shed light on the enigma of acoustic intervention for tinnitus. We designed a 75-day long-term acoustic intervention experiment, during which chronic tinnitus patients received daily modulated acoustic stimulation with each session lasting 15 days. Every 15 days, professional tinnitus assessments were conducted, collecting both electroencephalogram (EEG) and tinnitus handicap inventory (THI) data from the patients. Thereafter, we investigated the changes in EEG network organizations during continuous acoustic stimulation and their progressive evolution throughout long-term therapy, alongside exploring the associations between the evolving changes of the network alterations and THI. Our current study findings reveal reorganization in alpha/beta long-range frontal-parietal-occipital connections as well as local frontal and parietal-occipital regions induced by acoustic stimulation. Furthermore, we observed a decrease in modulation effects as therapy sessions progressed. These alterations in brain networks reflect the reversal of tinnitus-related neural activities, particularly distress and perception; thus contributing to tinnitus rehabilitation through long-term modulation effects. This study provides unique insights into how long-term acoustic intervention affects the network organizations of tinnitus patients and deepens our understanding of the pathophysiological mechanisms underlying tinnitus rehabilitation.

Examining the Potential of Cartoon-Based Simulations for Studying Mathematics Teachers’ Handling of Student Emotions: A Replication Study

Abstract Technology-mediated simulations of teaching are used increasingly to represent practice in the context of professional development interventions and assessment. Some such simulations represent students as cartoon characters. An important question in this context is whether simplified cartoon representations of students can convey similar meanings as real facial expressions do. Here, we share results from an implementation and replication study designed to observe whether and how (1) cartoon-based representations of emotion using graphical facial expressions can be interpreted at similar levels of accuracy as photo representations of emotions using actors and (2) the inclusion of markers of student emotions in storyboard-based scenarios of secondary mathematics teaching affects teachers’ appropriateness rating of the actions taken by a teacher represented in the storyboard. We show graphical representations of emotions can evoke particular intended emotions and that markers of student emotions in representations of practice could cue mathematics teachers into particular judgments of action. The Impact Sheet to this article can be accessed at 10.6084/m9.figshare.24219964

Online training in entrustable professional activities and work place-based assessment (portfolio) for clinical educators.

Online training in entrustable professional activities and work place-based assessment (portfolio) for clinical educators.