Non-academic Attributes Research Articles

Diversifying the Nursing Workforce Through Holistic Admissions Review to Nursing School.

Although a diverse healthcare workforce has been linked to improved care quality and cost savings, the U.S. nursing workforce does not mirror the population of underrepresented minority (URM) groups in the country. Holistic admissions review (HAR) is an innovative process that can increase the number of URM students entering nursing education programs. In addition to using traditional grade point average and entrance test scores for admissions criteria, HAR considers non-academic attributes such as personal qualities and life experiences. Nursing schools that adopt HAR can help diversify the nursing workforce. Lebacqz's (1987) Six Theories of Justice can aid Christian nurse educators in evaluating and advocating for HAR.

Determinants of Parental School Selection for Early Childhood Education: A Confirmatory Factor Analysis (CFA) Approach

Choosing the most suitable education for their children is often challenging for parents due to the many factors that must be considered. The desire to find the ideal kindergarten is complicated by the need to meet various criteria, leading to confusion and difficulty in decision-making. This study addresses this complexity by employing Confirmatory Factor Analysis (CFA) to simplify selection. Focusing on TKIT Al Farabi, the research validates a hypothesised model comprising ten critical factors: location, accreditation, facilities, fees, curriculum, religious education, teacher competence, extracurricular activities, school order and cleanliness, and alumni achievements. Data were collected from 154 parents through a structured questionnaire and analysed using SPSS software. The CFA results confirmed five dominant factors: school excellence, teacher professionalism, education costs, social development, and language development, collectively explaining 60.9% of the total variance. The study demonstrates that the CFA method effectively aids parents in making quick and accurate decisions regarding early childhood education. The findings also emphasise the significance of academic and non-academic attributes in school selection, suggesting that educational institutions should adopt more holistic curricula. These results have substantial implications for policymakers and educational administrators, underscoring the need for integrated programs that align with the diverse expectations of parents. Despite the study's valuable insights, further research in diverse settings is recommended to enhance the generalizability of the findings.

The impact of family involvement on students’ social-emotional development: the mediational role of school engagement

Family involvement has been identified as a mechanism that explains the differences in academic performance and well-being between students from different socioeconomic backgrounds. The implications of family involvement in students' non-academic outcomes have often been overshadowed by a focus on the academic domain. This study focuses on one type of non-academic attributes which is currently most critical to navigate in school and beyond: social-emotional development. In addition to that, the potential mediating role of school engagement in the association between family involvement and students' social-emotional development remains to be explored. This study aimed to investigate whether family involvement was associated with students' school engagement and social-emotional development and to clarify the underlying mechanism in the relationship. The sample consisted of 170 students from 8 to 17 years old and their parents who live in economically vulnerable situations and experience social exclusion. The analyses were performed using Jamovi statistical software and a GLM Mediation Model module. To address the research objectives, a series of mediation analysis were performed to fit the hypothesized relations among the study variables. The mediational analysis suggested that home-based family involvement could not predict students' social-emotional development, and that the effect of home-based family involvement on students' social-emotional development was fully mediated by school engagement, a variable not included in previous research. The results suggest that families who are actively engaged in their child's education at home positively influence students' level of participation in school, which, in turn, promotes the development of students' social-emotional competences.

Assessing professionalism in mental health clinicians: development and validation of a situational judgement test.

Situational judgement test (SJT) scores have been observed to predict actual workplace performance. They are commonly used to assess non-academic attributes as part of selection into many healthcare roles. However, no validated SJT yet exists for recruiting into mental health services. To develop and validate an SJT that can evaluate procedural knowledge of professionalism in applicants to clinical roles in mental health services. SJT item content was generated through interviews and focus groups with 56 professionals, patients and carers related to a large National Health Service mental health trust in England. These subject matter experts informed the content of the final items for the SJT. The SJT was completed by 73 registered nurses and 36 allied health professionals (AHPs). The primary outcome measure was supervisor ratings of professionalism and effectiveness on a relative percentile rating scale and was present for 69 of the participating nurses and AHPs. Personality assessment scores were reported as a secondary outcome. SJT scores statistically significantly predicted ratings of professionalism (β = 0.31, P = 0.01) and effectiveness (β = 0.32, P = 0.01). The scores demonstrated statistically significant incremental predictive validity over the personality assessment scores for predicting supervisor ratings of professionalism (β = 0.26, P = 0.03). These findings demonstrate that a carefully designed SJT can validly assess important personal attributes in clinicians working in mental health services. Such assessments are likely to represent evidence based, cost-effective tools that can support values-based recruitment to mental health service roles.

Broad vs. narrow traits: a scoping review of measuring personality traits in teacher selection using the situational judgment test.

Situational Judgment Tests (SJTs) have gained popularity and are commonly used as a measurement technique in a variety of professions, particularly those that include hiring, promoting, and professional development. In various educational sectors around the world, SJTs are being utilized as a measure by which to choose individuals who possess the requisite non-academic attributes for the profession. The objective of this review is to identify and analyze the traits that are measured in teacher selection using SJTs, in terms of both broad and narrow traits. This review uses a scoping review approach comprising five stages which are: identifying the research question, identifying relevant studies, selecting the studies, charting the data and reporting the results. Seven empirical research studies on teacher selection using SJTs were identified in which broad and narrow traits are used differently in selection. In the studies, a broad trait-conscientiousness-and seven narrow traits-organization and planning; empathy and communication; adaptability and resilience; mindset; emotional regulation; professional ethics; and enthusiasm and motivation-were recognized. Analysis revealed, in line with other prior studies, that the traits discovered tended to be used as the foundation for teacher selection criteria. The use of broad and narrow traits as the basis for teacher selection criteria has implications for the selection of the "best" teacher candidates because both broad and narrow traits generally do not accurately measure the precise characteristics needed. Future studies should focus on measuring more precise characteristics without overlap between the targeted characteristics, in light of the conclusions from this review.

Should New Zealand medical schools use a lottery system to select their students?

Over the years, entry into New Zealand medical programmes has become increasingly difficult and controversial. Many worthy candidates are rejected from medical school despite having a strong academic background and excellent non-academic attributes. Medical schools’ obsession over choosing the most “outstanding” applicants has created great concern over the fairness and predictive ability of current medical school selection procedures, with some scholars pro- posing the use of a lottery admission system to select future medical students. This paper examines the issues related to the current selection system and evaluates the potential feasibility for a lottery to become a more neutral, inclusive, and fairer admission system.

Breaking outside the box: Use of escape rooms in pharmacy residency interviews

AbstractBackgroundThe American Society of Health‐System Pharmacists Pharmacy Resident Match continues to be a competitive process. In recent years, postgraduate year 1 (PGY1) applicants have outpaced available positions. An increase in the number of highly qualified applicants has made identification of standout candidates challenging for residency programs. There is a need to assess nonacademic attributes, such as: leadership, communication, teamwork, problem‐solving, and self‐awareness. These are essential to pharmacy resident success, though are not easily elicited with traditional interview questions.AimsThe purpose of this interview escape room activity was to observe and differentiate PGY1 pharmacy residency candidates' nonacademic attributes and clinical knowledge through real‐time, problem‐based engagement. This descriptive report details the program's use of team‐based escape rooms in the pharmacy residency interview process and provides recommendations for developing and implementing an interview escape room activity.Materials and MethodsThe interview escape room was conducted for a PGY1 program at a large, academic medical center in San Antonio, Texas, during the 2020–2022 residency recruitment seasons. Participants were observed and assessed using the Communication and Teamwork Skills assessment.ResultsThe escape room allowed candidates to showcase their academic and nonacademic skills in various ways. Candidates reported feeling more relaxed than in traditional interviews.DiscussionElements of developing an interview escape room activity include planning and design, theme selection, knowledge and puzzle pairing, content testing, execution, and feedback.ConclusionInterview escape rooms provide insight into the skillset of candidates in the areas of communication, leadership, and teamwork, and create a memorable interview experience for both candidates and residency leadership.

Are different station formats assessing different dimensions in multiple mini-interviews? Findings from the Canadian integrated French multiple mini-interviews

BackgroundMultiple mini-interviews (MMI) are used to assess non-academic attributes for selection in medicine and other healthcare professions. It remains unclear if different MMI station formats (discussions, role-plays, collaboration) assess different dimensions.MethodsBased on station formats of the 2018 and 2019 Integrated French MMI (IFMMI), which comprised five discussions, three role-plays and two collaboration stations, the authors performed confirmatory factor analysis (CFA) using the lavaan 0.6-5 R package and compared a one-factor solution to a three-factor solution for scores of the 2018 (n = 1438) and 2019 (n = 1440) cohorts of the IFMMI across three medical schools in Quebec, Canada.ResultsThe three-factor solution was retained, with discussions, role-plays and collaboration stations all loading adequately with their scores. Furthermore, all three factors had moderate-to-high covariance (range 0.44 to 0.64). The model fit was also excellent with a Comparative fit index (CFI) of 0.983 (good if > 0.9), a Tucker Lewis index of 0.976 (good if > 0.95), a Standardized Root Mean Square Residual of 0.021 (good if < .08) and a Root Mean Square Error of 0.023 (good if < 0.08) for 2018 and similar results for 2019. In comparison, the single factor solution presented a lower fit (CFI = 0.819, TLI = 0.767, SRMR = 0.049 and RMSEA = 0.070).ConclusionsThe IFMMI assessed three dimensions that were related to stations formats, a finding that was consistent across two cohorts. This suggests that different station formats may be assessing different skills, and has implications for the choice of appropriate reliability metrics and the interpretation of scores. Further studies should try to characterize the underlying constructs associated with each station format and look for differential predictive validity according to these formats.

Measurement of Non-academic Attributes in the Situational Judgment Test as Part of School Teacher Selection: Systematic Literature Review

The Situational Judgment Test (SJT) has become an increasingly well-known measurement method that is frequently used in various fields, especially for personnel selection, promotion, and professional development. The SJT also has a greater potential in relation to the selection of teachers in the education sector. Teacher selection aspects such as non-academic attributes, specifically the interpersonal and intrapersonal, are the focus of this study. This study uses a Systematic Literature Review (SLR) consisting of a review protocol to determine the topic that has been researched and the method used for making revisions. The SLR approach has four phases: searching, screening, analysing, and the results with numerous criteria established. The review consists of seven studies on teacher selection using the SJT instrument over the past ten years during the period January 2012 to December 2021. Eight interpersonal attributes were obtained based on six previous studies, namely organisation, planning, empathy, communication, teaching, relationships with colleagues, counselling, and contingency. Meanwhile seven intrapersonal attributes were obtained, namely conscientiousness, mindset, emotion regulation, adaptability, enthusiasm and motivation, resilience, and professional ethics. The attributes found can be utilised as they are fundamental for teacher selection criteria. The previous studies employed the same attributes. However, the attributes should only be employed according to the suitability of the selection context being performed.

Evaluation of Situational Judgment Tests in student selection in Indonesia and the impact on diversity issues

BackgroundInternationally, medical selection relies heavily on prior academic attainment which has an adverse impact on the diversity of selected students. Since non-academic attributes are also important, this study aims to evaluate the use of a Situational Judgment Test (SJT) for selection and the impact on student diversity relating to gender, ethnicity and socio-economic status. Previous SJT research has almost entirely originated from a Western context and this study focuses on new evidence in a South East Asian context with a different demographic profile.MethodsThirty faculty members developed 112 SJT scenarios assessing professionalism, communication and self-awareness domains. The scenarios underwent a concordance stage where stakeholder input was sought on the content appropriateness, to define the item scoring key, followed by an initial psychometric evaluation with first and second year medical students (N = 436). Based on these results, 30 scenarios, consisting of 128 nested items, were selected for pilot testing and evaluation regarding diversity issues with two cohorts of applicants in 2017 (N = 446) and 2018 (N = 508).ResultsThe SJT demonstrated good internal consistency (Cronbach’s alpha of 0.80 and 0.81 respectively). There were significant differences in SJT scores based on gender in both years, where females consistently outperformed males (p = .0001). However, no significant differences were found based on high school origin, parental educational background or ethnicity.ConclusionsThis is the first study to evaluate the use of an SJT in Indonesia, which has a unique diversity profile compared to Western countries. Largely, the preliminary results replicate previous studies of the potential diversity benefits of using an SJT as a tool for medical student selection and has the potential to level the playing field regarding socio-economic status and ethnicity. Further studies exploring more variables representing diversity are warranted to confirm the early results in this study.

Pre-service Science and Mathematics teachers’ reasoning: a think-aloud study

ABSTRACT Teacher education programmes struggle to attract, develop, and retain potential teachers in Science and Mathematics. The development of both academic and non-academic attributes (e.g. adaptability, empathy) during a programme can influence not only retention but the profession-readiness of graduates. This is especially important in underserved schools where high attrition rates are more likely with Science and Mathematics teachers in their first few years of teaching. Yet most programmes lack intentional opportunities for non-academic development. Using a qualitative case study approach with an established think-aloud protocol, nine pre-service teachers (Science or Mathematics) were presented with situational judgment test items. A three-step analytical strategy revealed participants’ reasoning with a range of motivational beliefs and values. Results point to four broad reasoning profiles (solution, consequence, student, and value-focused). By exploring the implicit and explicit beliefs and values that contribute to prospective teachers’ reasoning processes, we offer implications for professional development and future research.

Employing Situational Judgment Tests During the Medical Training

In the field of medicine, the assessment of medical students conventionally has been carried out on the basis of academic performance alone. However, it is a fact that a medical professional should possess much more than medical knowledge alone and that's the reason why other core competencies have been defined by the regulatory bodies across the world. This translates to the immense need to assess the professional characteristics of a medical student, as they are equally important attributes in the making of a competent health care professional. Situational judgement test is a tool to assess the non-academic attributes in a medical student and has been acknowledged as an effective method for teaching, training and practicing medicine. In conclusion, the situational judgment test is an extremely cost-effective, valid and reliable approach to assess the non-academic attributes of the medical students in their workplace. This calls for the need to introduce them in all the medical institutions for both undergraduate and postgraduate courses, as it will definitely prepare them for the challenges of clinical practice.

Important non-academic attributes in Australian initial teacher education

Important non-academic attributes in Australian initial teacher education

Reflective and integrative learning and the role of instructors and institutions—evidence from Malaysia

The shift in contemporary workplaces has caused higher education institutions to place importance on developing non-academic attributes along with academic success to help students accomplish academic and occupational goals. Reflective and integrative learning as a cumulative process of students’ experiences inside and outside the classroom during university years can facilitate the development of desired attributes among undergraduates. The current study, grounded in Biggs’ (Higher education research and development, 12(1), 73-85, 1993) 3P model approach, investigated the role of student-faculty interaction, assessment and feedback, and campus environment as presage factors, and reflective and integrative learning as the process factor and academic and soft skills gain as the product factors into a full mediation model. A total of 1892 final year Malaysian undergraduate students from 18 universities across Malaysia participated in the cross-sectional survey study. The hypothesized model was tested using structural equation modeling. The results revealed that reflective and integrative learning fully mediates the relationship between student-faculty interaction, assessment and feedback, campus environment, and academic and soft skills gains. The implications for teaching and learning and student development are discussed.

Identifying Non-Performing Students in Higher Educational Institutions Using Data Mining Techniques

The educational institutes are focusing on improving the performance of students by using several data mining techniques. Since there is an increase in the number of drop out students every year, if we are able to predict whether a student will complete the course or not, it is possible to take some preventive actions beforehand. The primary data set used for modelling has been taken from a reputed technical institute of Uttar Pradesh which consists of data of 6,807 students containing 20 academic and non-academic attributes. The most relevant attributes are extracted using CorrelationAttributeEval (in WEKA) technique using Ranker search method which ranks the attributes as per their evaluation. Synthetic minority oversampling technique (SMOTE) filter is applied to deal with the skewed data set. The models are built from eight classifiers that are analysed for predicting the most appropriate model to classify whether a student will complete the course or withdraw his/her admission.

Situational judgement test: Psychometric analysis of a pilot study for selecting post graduate medical student in residency program

Introductions: Selection process of post graduate medical students requires combination of knowledge, cognitive abilities and skills. Situational judgement test (SJT) is one on the important tools to measure cognitive abilities and skills. This study aims to measure the internal consistency reliability of SJT tool and item quality for local validation of the non-academic attributes. It also aims to do sub-group analysis of SJT scores based on this tool to provide further evidence for validity. &#x0D; Methods: This cross-sectional study was conducted at Patan Academy of Health Sciences (PAHS) in May 2017. Two sets of SJTs were developed after iterative discussion and modification to suit the local context. Set A had five options to a given situation, students had to rank these options from most appropriate to least appropriate. Set B had seven options to a given situations, students had to pick three best options. Medical officers and interns who were working at PAHS as medical officers participated in this study. &#x0D; Results: One hundred and sixteen medical officers participated in the study. Thirty-nine (33.6%) participants were interns who had graduated from PAHS and 77 (66.4%) were medical officers who had graduated from various institute inside and outside the Nepal. The overall Cronbach’s alpha for 35 questions was 0.65, that for set A (19 questions) was 0.56 and that for set B (16 questions) was 0.52. Adding SJT questions improved value of Cronbach’s alpha for SJT test as 40, 50, 60 and 70 questions gave Cronbach’s alpha of 0.68, 0.73, 0.76 and 0.79. Average percentage correct of set A was 76.3% and that of set B was 60.5%. SJT scores were statistically different for medical graduates from Nepal and different universities within Nepal. &#x0D; Conclusions: Locally developed situational judgement test is found to be reliable instrument for measuring non-academic construct of post-graduate medical entrance examination.

Understanding the reasoning of pre-service teachers: a think-aloud study using contextualised teaching scenarios

ABSTRACTThis qualitative study sought to understand the reasoning of pre-service teachers through think-aloud interviews with teacher education students at the beginning of their postgraduate degree (six elementary and six secondary). Interviews focused on contextualised and challenging teaching scenarios with a range of response options previously confirmed through the use of situational judgement test (SJT) methodology. The authors’ three-step analysis revealed seven concepts that highlighted the motivations and beliefs underlying the reasoning of pre-service teachers. Practical implications include professional development around decision-making during teacher education programs. Future research will explore the use of SJTs in developing key non-academic attributes for effective teaching.

School Peer Non-academic Skills and Academic Performance in High School

Research shows that students’ non-academic attributes, such as forms of engagement, dispositions, and social and emotional skills, are associated with a range of outcomes including academic performance. However, little research has investigated the effects of school peer non-academic attributes on academic performance. This study begins to address this gap in the research literature by examining the effects of ten measures of school peer nonacademic attributes. Importantly, most of the non-academic attributes examined in this study are malleable through school-based interventions. The results show that five measures of school peer attributes have medium to large effects on academic performance including collaboration skills (a social-emotional characteristic), conscientiousness and belonging (dispositions), and cognitive and behavioral engagement. In contrast, the corresponding effects of student’s own non-academic attributes were uniformly smaller. These findings indicate that the non-academic attributes of one’s school peers play an important role in academic performance above and beyond one’s own non-academic attributes. These results suggest that school-wide interventions and instructional practices designed to improve the non-academic skills of all students will provide additional benefits compared with interventions focusing on students with the most under-developed non-academic attributes.

The development of a situational judgement test of personal attributes for quality teaching in rural and remote Australia

Education authorities in Australia are calling for valid tools to help assess prospective teachers’ non-academic attributes, with a particular need for identifying those attributes necessary for effective teaching in specific contexts. With the New South Wales (NSW) Department of Education, we aimed to develop a scenario-based tool to help assess the non-academic attributes necessary for beginning teachers working in rural and remote settings. Using a situational judgement test (SJT) methodology, we worked with experienced teachers (n = 19) to develop scenario-based items, which were then reviewed by school principals (n = 13). The teachers also adapted items previously developed and piloted in the UK. Next, prospective NSW teachers (n = 99) tried 32 new and adapted items targeting four clusters of attributes: empathy and communication, resilience and adaptability, organisation and planning, and culture and context. Item quality analyses revealed 22 acceptable items. We conclude by suggesting SJTs for promoting non-academic growth of prospective and beginning teachers.

The Predictive Validity of a Text-Based Situational Judgment Test in Undergraduate Medical and Dental School Admissions.

Situational judgment tests (SJTs) can be used to assess the nonacademic attributes necessary for medical and dental trainees to become successful practitioners. Evidence for SJTs' predictive validity, however, relates predominantly to selection in postgraduate settings or using video-based SJTs at the undergraduate level; it may not be directly transferable to text-based SJTs in undergraduate medical and dental school selection. This preliminary study aimed to address these gaps by assessing the validity of the UK Clinical Aptitude Test (UKCAT) text-based SJT. Study participants were 218 first-year medical and dental students from four UK undergraduate schools who completed the first UKCAT text-based SJT in 2013. Outcome measures were educational supervisor ratings of in-role performance in problem-based learning tutorial sessions-mean rating across the three domains measured by the SJT (integrity, perspective taking, and team involvement) and an overall judgment of performance-collected in 2015. There were significant correlations between SJT scores and both mean supervisor ratings (uncorrected r = 0.24, P < .001; corrected r = 0.34) and overall judgments (uncorrected rs = 0.16, P < .05; corrected rs = 0.20). SJT scores predicted 6% of variance in mean supervisor ratings across the three nonacademic domains. The results provide evidence that a well-designed text-based SJT can be appropriately integrated, and add value to, the selection process for undergraduate medical and dental school. More evidence is needed regarding the longitudinal predictive validity of SJTs throughout medical and dental training pathways, with appropriate outcome criteria.