Aptitude Assessment Research Articles

Examining Construct Congruence for Psychometric Tests: A Note on an Extension to Binary Items and Nesting Effects.

This article extends the procedure outlined in the article by Raykov, Marcoulides, and Tong for testing congruence of latent constructs to the setting of binary items and clustering effects. In this widely used setting in contemporary educational and psychological research, the method can be used to examine if two or more homogeneous multicomponent instruments with distinct components measure the same construct. The approach is useful in scale construction and development research as well as in construct validation investigations. The discussed method is illustrated with data from a scholastic aptitude assessment study.

The Emergence of Item Response Theory Models and the Patient Reported Outcomes Measurement Information Systems

Item response theory (IRT) models emerged to solve practical testing problems in large-scale cognitive achievement and aptitude assessment. Within the last decade, an explosion of IRT applications have occurred in the non-cognitive domain. In this report, I highlight the development, implementation, and results of a single project: Patient Reported Outcomes Measurement Information Systems (PROMIS). The PROMIS projectreflects the state-of-the-art application of IRT in the non-cognitive domain, and has produced important advancements in patient reported outcomes measurement.However, the project also illustrates challenges that confront researchers wishing to apply IRT to non-cognitive constructs. These challenges are: a) selecting a population to set the metric for interpretation of item parameters, b) working with non-normal quasi-continuous latent traits, and c) working with narrow-bandwidth constructs that potentially have a limitedpool of potential indicators. Differences between cognitive and non-cognitive measurement contexts are discussed and directions for future research suggested.

The predictive value of aptitude assessment in laparoscopic surgery: a meta-analysis.

Current methods of assessing candidates for medical specialties that involve laparoscopic skills suffer from a lack of instruments to assess the ability to work in a minimally invasive surgery environment. A meta-analysis was conducted to investigate whether aptitude assessment can be used to predict variability in the acquisition and performance of laparoscopic skills. PubMed, PsycINFO and Google Scholar were searched to November 2014 for published and unpublished studies reporting the measurement of a form of aptitude for laparoscopic skills. The quality of studies was assessed with QUADAS-2. Summary correlations were calculated using a random-effects model. Thirty-four studies were found to be eligible for inclusion; six of these studies used an operating room performance measurement. Laparoscopic skills correlated significantly with visual-spatial ability (r=0.32, 95% confidence interval [CI] 0.25-0.39; p<0.001), perceptual ability (r=0.31, 95% CI 0.22-0.39; p<0.001), psychomotor ability (r=0.26, 95% CI 0.10-0.40; p=0.003) and simulator-based assessment of aptitude (r=0.64, 95% CI 0.52-0.73; p<0.001). Three-dimensional dynamic visual-spatial ability showed a significantly higher correlation than intrinsic static visual-spatial ability (p=0.024). In general, aptitude assessments are associated with laparoscopic skill level. Simulator-based assessment of aptitude appears to have the potential to represent a job sample and to enable the assessment of all forms of aptitude for laparoscopic surgery at once. A laparoscopy aptitude test can be a valuable additional tool in the assessment of candidates for medical specialties that require laparoscopic skills.

Speech rhythm sensitivity and musical aptitude: ERPs and individual differences

This study investigated the electrophysiological markers of rhythmic expectancy during speech perception. In addition, given the large literature showing overlaps between cognitive and neural resources recruited for language and music, we considered a relation between musical aptitude and individual differences in speech rhythm sensitivity. Twenty adults were administered a standardized assessment of musical aptitude, and EEG was recorded as participants listened to sequences of four bisyllabic words for which the stress pattern of the final word either matched or mismatched the stress pattern of the preceding words. Words with unexpected stress patterns elicited an increased fronto-central mid-latency negativity. In addition, rhythm aptitude significantly correlated with the size of the negative effect elicited by unexpected iambic words, the least common type of stress pattern in English. The present results suggest shared neurocognitive resources for speech rhythm and musical rhythm.

Current understanding of learning psychomotor skills and the impact on teaching laparoscopic surgical skills

Key content Trainees face many challenges in learning the skill set required to perform laparoscopic surgery. The time spent in the operating room has been detrimentally impacted upon since the implementation of the European Working Time Directive. In order to address the deficit, surgical educators have looked to the benefits enjoyed in the aviation and sports industries in using simulation training. Learning objectives To summarise the current understanding of the neuropsychological basis of learning a psychomotor skill. To clarify factors that influence the acquisition of these skills. To summarise how this information can be used in teaching and assessment of laparoscopic skills. Ethical issues The use of virtual reality simulators may be able to form a part of the aptitude assessment in the selection process, in order to identify trainees with the desired attributes to progress into the training programmes. However, as skill improves with practice, is it ethical to exclude novices with poor initial performance assessment before allowing them the opportunities to improve?

Cognitive abilities of health and art college students a pilot study.

[Purpose] The selection of a college major is a struggle that high school students undergo every year; however, there is a dearth of studies examining the role of cognitive ability tests as a tool for determining the aptitude of prospective students. Hence, the purpose of this study was to assess cognitive ability differences among students. [Subjects and Methods] A convenience sample of 60 college students (30 health science and 30 art students) with a mean age of 19 ± 1.6 years, voluntarily participated in this study. Cognitive ability was assessed using the self-administered Cognitive Assessment of Minnesota (CAM) scale under the supervision of a researcher. [Results] The findings indicated that there was a significant cognitive ability difference between health science and art students, especially in the cognitive components of knowledge, calculation, and thinking. However, the difference in the social cognitive component of both the health science and art students was not significant. [Conclusion] The results indicate that the health science students’ cognitive abilities were better than those of the art students. This finding implies that it is important for high school graduates to undertake a cognitive ability assessment prior to choosing a subject major. Hence, it is recommended that cognitive scales should be included as an aptitude assessment tool for the decision-makers and prospective students to determine an appropriate career, since it might reduce the percentage of university drop-out ratio.

Phosphatidylethanol (PEth) in blood samples from "driving under the influence" cases as indicator for prolonged excessive alcohol consumption.

Phosphatidylethanol (PEth) is considered as specific biomarker of alcohol consumption. Due to accumulation after repeated drinking, PEth is suitable to monitor long-term drinking behavior. To examine the applicability of PEth in "driving under the influence of alcohol" cases, 142 blood samples with blood alcohol concentrations (BAC) ranging from 0.0-3.12‰ were analyzed for the presence of PEth homologues 16:0/18:1 (889 ± 878 ng/mL; range <LOQ to 5400 ng/mL) and 16:0/18:2 (355 ± 315 ng/mL; range <LOQ to 1440 ng/mL) by LC-MS/MS. With receiver operating characteristic analysis, PEth thresholds were evaluated to differentiate moderate and excessive alcohol consumption with acceptable sensitivity and specificity in accordance with the 1.6‰ BAC limit. With a threshold of 700 ng/mL for PEth 16:0/18:1, prolonged excessive alcohol consumption was detected in 65.9% of drunk drivers with a BAC ≥ 1.6‰ and in 31.6% of the samples with a BAC < 1.6‰. Similar results were obtained for PEth 16:0/18:2 with a threshold of 300 ng/mL. Both criteria, PEth 16:0/18:1 and PEth 16:0/18:2, were conform in the evaluation of drinking habits in 88.7% of blood samples. These results show the possibility to detect prolonged excessive alcohol consumption, even if the BAC is below the legal threshold of 1.6‰ for driving aptitude assessment. As a consequence, concentrations of PEth 16:0/18:1 ≥ 700 ng/mL and of PEth 16:0/18:2 ≥ 300 ng/mL may be considered as indicators for the necessity of driving aptitude assessment in addition to BAC.

Nursing Student Adaptation During A Semester Abroad

This study was completed to understand correlations between undergraduate nursing students’ initial readiness for cross-cultural experience in study abroad and final levels of socio-cultural adaptation. Deardorff (2006) suggests that attitudes, values, knowledge, and skills are essential factors leading to effective function in a new culture. Her Developmental Model of Intercultural Competence was the guiding framework for this research study. Two groups of American nursing students traveling to South Africa and Puerto Rico for a semester were invited to participate. Students completed the Global Competence Aptitude Assessment prior to departure and the Socio-cultural Adaptation Scale at week four and upon return from abroad, along with a final survey. Findings demonstrate significant correlations between students’ internal and external readiness scores and final socio-cultural adaptation scores, and are supported by final survey stu dent comments. Implications for nursing education are discussed.

Automobile driving capacity in dementia

Dementia influences at an early stage the driving aptitude of motor vehicle steering persons. Every year in Switzerland, around 16'000 driving permit holders suffer newly from dementia; therefore the driving aptitude is questioned, especially because of possibly limited executive functions. Individuals with early-stage dementia often may show a dangerous driving stile. However, a mild dementia does not a priori exclude the driving aptitude, and less than half of these drivers can continue driving for another 1 - 3 years. In contrast, there is no further driving aptitude in presence of moderate dementia. In the assessment of driving aptitude, the underlying cause of dementia is always taken into account. Cognitive short tests such as the Mini-Mental Status Exam, Clock Drawing Test and Trail-Making Test are not suitable to make reliable statements about the aptitude to drive, but these tests are very important for the initial diagnosis of dementia in primary care practice and can lead the way for further examination concerning driving aptitude. The legally prescribed regular check-up for motorists aged over 70 years in Switzerland provides an ideal opportunity for early detection of incipient dementia. The practical procedure for the assessment of aptitude to drive in the primary care practice is presented. The physician-guided on-road driving test represents a meaningful, practical and relatively cost-effective tool for the evaluation of driving aptitude in cases of doubt.

Current nutritional status of patients with rheumatic diseases in the population of Poland.

The aim of the studyThe aim of the study was to evaluate the current state of nutrition of patients with rheumatic diseases in the Polish population.Material and methodsAn anonymous questionnaire study was carried out among the patients of the Institute of Rheumatology in Warsaw in the fourth quarter of 2012. Five hundred questionnaires were distributed, and 397 questionnaires were collected and accepted for further analysis (response rate = 79%).ResultsOverweight or obesity was present in more than half (53%) of the patients (overweight in 30.5% of respondents, obesity in 22.6%). Among obese subjects, 43% of men and 37% of women in the study think that their diet is correct. Sixty-eight percent of respondents declared that they do not follow any special diet and only 18% declared that they follow a diet with a reduced quantity of monosaccharides (no sweets). A milk-free diet was followed by 7% of respondents, a meat-free diet by 6%, and a fruit-and-vegetable diet by 5%. Dietary supplements were regularly used by 26.7% of respondents, whereas 33.8% did not use them at all. The average assessment of physical aptitude (Health Assessment Questionnaire – HAQ) in the group of respondents was 0.71. No statistically significant differences were found between higher level of disability (e.g. HAQ ≥ 1) and the type of diet followed (p = 0.678) or body mass index (BMI) value (p = 0.864) in relation to persons with the value of HAQ < 1.ConclusionsMore than half of patients suffering from rheumatic diseases are overweight or obese, which corresponds to the body weight profile of the population of Poland. Most patients diagnosed with rheumatic diseases do not follow any special diet. In spite of the frequent use of dietary supplements, the patients do not consult a doctor or a dietician about it. The type of diet and BMI value do not differ according to the level of disability.

Method of assessment of technical object aptitude in environment of exploitation and service conditions

Method of assessment of technical object aptitude in environment of exploitation and service conditions

Сравнительный анализ эффективности методов нечеткого моделирования (на примере решения задачи оценки профессиональных склонностей студентов)

Исследовано построение гибридной модели оценки компетентности и профессиональных склонностей студентов, разработки информационно-аналитической системы оценки рейтинга студентов и выпускников, ее интеграции посредством web-сервисов с программноинструментальным комплексом «Бизнес-Аналитик». На основе данных, занесенных в систему, были проведены вычислительные эксперименты по сравнению эффективности применения различных методов нечеткого моделирования: экспертных систем, многослойных персептронов и нечетких нейронных сетей Такаги – Сугено – Канга. Показаны основные преимущества нечетких сетей и их конкретной программной реализации в аналитической платформе «БизнесАналитик». Возможности гибридных систем и сетей, которые не только используют априорную информацию о предметной области, но и могут приобретать новые знания и при этом являться для пользователя логически прозрачными, позволяют широко применять такие методы нечеткого моделирования при решении сложных неформализованных задач управления. Ключевые слова: оценка компетентности студентов, web-сервисы, гибридные экспертные системы, методы нечеткого моделирования, нечеткие нейронные сети. The paper is devoted to elaboration of a hybrid model for assessment of competence and vocational aptitudes of students, development of information-analytical system of students and graduates rating evaluation through its integration with WEB-services and software tool set Business Analyst. Simulation experiments based on the entered data have been conducted to compare the efficacy of fuzzy modeling, expert systems, multilayer perceptron neural networks and Takagi – Sugeno – Kang fuzzy networks. The paper shows the main advantages of fuzzy networks and their specific software implementation in the analytic platform Business Analyst. Capabilities of hybrid systems and networks that not only use a priori information about the domain but can acquire new knowledge and, thus, be logically transparent to the user allow such methods of fuzzy modeling to be widely used in solving complex non formalized management tasks.

Co mierzą narzędzia psychometryczne stosowane w Polsce do diagnozy predyspozycji kierowców? Doniesienie z badań

The safety performance of road drivers requires an improvement of the mechanism of selecting candidates for professional drivers. Unfortunately, it has been common practice until now to design diagnostic methods to reflect the theoretical constructs of traits and abilities considered useful in road traffic. We decided to adopt the opposite, complementary approach and to analyze what the methods used in Polish transport psychology really measure and what theoretical constructs that corresponds to. The results will be treated as a first step towards determining the prognostic validity of these psychometric tools. We tested 300 professional male drivers, aged form 21 to 65 years, belonging to six groups of equal size: victims of collisions, victims of accidents, perpetrators of collisions, perpetrators of accidents, drivers stopped by the police for drunk driving and those who had never been involved in any of the above situations. The analysis concerned 27 indicators taken from nine diagnostic tools commonly used by transport psychologists in Poland. Exploratory factor analysis was performed to determine the latent factor structure of these methods. The Kaiser criterion allowed us to identify the eight-factor solution as the optimal one. The extracted factors are: attention, accuracy in visual perception, mental alertness, sense of community, efficiency of reactiveness and decision making, cognitive abilities (logical induction and grasping analogy), agency, and sensitivity to social approval.

Beyond credentialing in physician selection: Application of an instrument that measures behavioral aptitude

This article explores the idea that the assessment of candidates for the role of evaluating their inter-personal and behavioral aptitude as well as their clinical skills. determine whether results of a structured interview correlate collected: a structured aptitude assessment for physicians (the Physician Interview) and job performance data for physicians. Analysis of performance data allowed categorization of the physicians into three groups: top performers contrast performers, and neither. The two data sets were then analyzed to assess the correlation between a physician’s job performance and score on the Physician Interview. system. Sixty-three physicians were nominated for inclusion. Nineteen physicians met the criteria as top twenty-three as contrast performers. Twenty suggest that applying the structured Physician Interview as a standard step in the selection process can significantly increase the likelihood of identifying top-

A study to assess the feasibility of Text Messaging Service in delivering maternal and child healthcare messages in a rural area of Tamil Nadu, India.

Mobile text messaging is a potentially powerful tool for behaviour change because it is widely available, inexpensive, and instant. To evaluate whether mobile Text Messaging Service is a feasible mode of raising knowledge regarding maternal and child health (MCH) and to explore issues related to mobile text messages as a mode of health education. A community-based intervention study was conducted from January to June 2013 in six randomly selected villages of Vellore district, Tamil Nadu. A multi-stage sampling technique was followed: 120 individuals from 120 households (30 clusters in six villages) were contacted. Data was collected using a pretested questionnaire by house-to-house visits in three phases: 1) baseline assessment of aptitude towards text messages; 2) intervention: sending MCH-related text messages; and 3) end-line assessment to evaluate the increase in knowledge level. Qualitative data regarding mobile text messages as a mode of health education was explored. Quantitative data was analysed using SPSS version 17.0 and qualitative data by Anthropac software. Of the individuals surveyed, 69.17 per cent and 52.5 per cent were "able to read" and "type and send" text messages, respectively. Seventy per cent of individuals were willing to receive health information via text messages, and 98.33 per cent believed text messages could effectively spread health messages. A significant increase in knowledge was observed following text messages. Male gender and subjects' ability to read text messages were significantly associated. Factors related to mobile phone use include minimum economic burden, easy availability, portability, and ease of use. Factors related to mobile text messages as a mode of health message delivery include direct receipt of information, mass reach, the absence of regional language font in many handsets, and illiterate individuals being unable to read messages. In rural areas, mobile text messages have the potential to deliver health messages regarding MCH.

The Relationships Among Premilitary Vocational Aptitude Assessment, Traumatic Brain Injury, and Postdeployment Cognitive Functioning in Combat Veterans

Traumatic brain injury (TBI) in Iraq and Afghanistan war veterans is frequently associated with a variety of complaints, including cognitive problems and posttraumatic stress disorder. In this study, the authors explored the predictive impact of premilitary cognitive abilities on postdeployment cognitive functioning, as mitigated by posttraumatic stress symptoms in a sample of veterans with and without history of TBI. Measures included clinical interview, neuropsychological tests, the PTSD Checklist-Military Version, and the Armed Services Vocational Aptitude Battery. In contrast to history of TBI, premilitary abilities and posttraumatic stress symptoms emerged as significant predictors of postdeployment cognitive deficits.

Pune low birth weight study — Birth to adulthood — Cognitive development

To assess the cognitive development of non-handicapped low birth weight (LBW) infants at 18 years. Prospective cohort study. Infants born between 1987 - 1989 with birth weight less than 2000 g and discharged from a neonatal special care unit were followed up till the age of 18 years. The intelligence quotient (IQ) was determined by Ravens progressive matrices. Assessment of adjustment and aptitude was done. The cohort of 161 LBW infants was divided into three groups according to their gestation - preterm SGA (n=61), full term SGA (n=30) and preterm AGA (n=70). 71 full term AGA infants served as controls. The IQ of the study group (Percentile 39.3) was significantly lower than that of controls (Percentile 54.9) (P=0.002). Preterm SGA subjects had the lowest IQ (Percentile 35.5), though just within normal limits. Males from the study group had significantly lower IQ than male controls (P=0.03). The IQ of PTSGA subjects of college educated mothers (P=0.004) and belonging to higher socio-economic class (P=0.04) was significantly higher. On the differential aptitude test, PTSGA subjects were poor in speed and mechanical reasoning. The 18 year IQ could be best predicted by IQ at 6 and 12 years. Preterm SGA children have the lowest IQ at 18 years, males have lower IQ. Maternal education and socio-economic status have great impact on cognitive development. Good prediction of the 18 year IQ can be done by the 6 and 12 year IQ.

Letting a Typical Mouse Judge Whether Mouse Social Interactions Are Atypical

Diagnosis of an autism spectrum disorder (ASD) requires a qualitative assessment of social aptitude: one person judging whether another person interacts in a "typical" way. We hypothesized that mice could be used to make a similar judgment if they prefer "typical" over "atypical" social interactions with mouse models relevant to ASD. We used wild-type C57BL/6 (B6) mice as "judges" and evaluated their preference for a chamber containing a "typical" (B6 or 129S6) or an "atypical" mouse. For our atypical mouse stimuli, we chose two inbred strains with well-documented social phenotypes (BTBR and BALB/c), as well a mutant line with abnormal social behavior and seizures (Gabrb3 +/-). Overall, we observed a stimulus by time interaction (P < 0.0001), with B6 mice preferring the typical mouse chamber during the last 10 min of the 30-min test. For two of the individual stimulus pairings, we observed a similar chamber by time interaction (BALB/c vs. 129S6, P = 0.0007; Gabrb3 +/- vs. 129S6, P = 0.033). For the third stimulus pairing, we found a trend for preference of the typical mouse across time (BTBR vs. B6, P = 0.051). We repeated the experiments using 129S6 mice as judges and found a significant overall interaction (P = 0.034), but only one stimulus pairing reached significance on its own (BALB/c vs. 129S6, P = 0.0021). These data suggest that a characteristic pattern of exploration in B6 mice can distinguish some socially atypical animals from controls.

The selection process in the Faculty of Medicine: the usefulness of a psychological and aptitude assessment

In almost all the universities worldwide, the admission to the Faculty of Medicine is subject to a specific selection process. In most cases tests are used to assess the cognitive abilities of the candidates. However, a growing number of universities (particularly American and Canadian) is using a set of instruments to evaluate non-cognitive skills in addition to these tests. Among the most commonly used tools are included personal interviews, Multiple Mini Interview (MMI), Personal Quality Assessment (PQA). In Italy in the last decade increasing emphasis was placed on assessing students' attitudes through the use of orientation tests (given in classrooms or online fillable), as part of several projects that involve collaboration between secondary school and university. Nevertheless, the admission to the Faculty of Medicine does not yet provide a psychological and aptitude assessment, but relies exclusively on cognitive features. In a similar way to what is already the case with the selection of personnel in law enforcement agency, we propose a selection model that includes an assessment of psychological features and aptitudes of the candidates, as well as cognitive skills.

Reliability and acceptability of a five-station multiple mini-interview model for residency program recruitment

BackgroundStandard interviews are used by most residency programs in the United States for assessment of aptitude of the non-cognitive competencies, but variability of interviewer skill, interviewer bias, interviewer leniency or stringency, and context specificity limit reliability.AimTo investigate reliability and acceptability of five-station multiple mini-interview (MMI) model for resident selection into an internal medicine residency program in the United States.SettingOne independent academic medical center.ParticipantsTwo hundred and thirty-seven applicants and 17 faculty interviewers.Program descriptionFive, 10-min MMI stations with five different interviewers blinded to the candidate's records and one traditional 20-min interview with the program director. Candidates were rated on two items: interpersonal and communication skills, and overall performance.Program evaluationGeneralizability data showed that the reliability of our process was high (>0.9). The results of anonymous surveys demonstrated that both applicants and interviewers consider the MMI as a fair and more effective tool to evaluate non-cognitive traits, and prefer the MMI to standard interviews.DiscussionThe MMI process for residency interviews can generate reliable interview results using only five stations, and it is acceptable and preferred over standard interview modalities by the applicants and faculty members of one US residency program.