Differences In General Performance Research Articles

Construct validity of multiple mini interviews – Investigating the role of stations, skills, and raters using Bayesian G-theory

Background: One popular procedure in the medical student selection process are multiple mini-interviews (MMIs), which are designed to assess social skills (e.g., empathy) by means of brief interview and role-play stations. However, it remains unclear whether MMIs reliably measure desired social skills or rather general performance differences that do not depend on specific social skills. Here, we provide a detailed investigation into the construct validity of MMIs, including the identification and quantification of performance facets (social skill-specific performance, station-specific performance, general performance) and their relations with other selection measures. Methods: We used data from three MMI samples (N = 376 applicants, 144 raters) that included six interview and role-play stations and multiple assessed social skills. Results: Bayesian generalizability analyses show that, the largest amount of reliable MMI variance was accounted for by station-specific and general performance differences between applicants. Furthermore, there were low or no correlations with other selection measures. Discussion: Our findings suggest that MMI ratings are less social skill-specific than originally conceptualized and are due more to general performance differences (across and within-stations). Future research should focus on the development of skill-specific MMI stations and on behavioral analyses on the extents to which performance differences are based on desirable skills versus undesired aspects.

Comparison of Different Sample Preparation Protocols Reveals Lysis Buffer-Specific Extraction Biases in Gram-Negative Bacteria and Human Cells

We evaluated different in-solution and FASP-based sample preparation strategies for absolute protein quantification. Label-free quantification (LFQ) was employed to compare different sample preparation strategies in the bacterium Pseudomonas aeruginosa and human embryonic kidney cells (HEK), and organismal-specific differences in general performance and enrichment of specific protein classes were noted. The original FASP protocol globally enriched for most proteins in the bacterial sample, whereas the sodium deoxycholate in-solution strategy was more efficient with HEK cells. Although detergents were found to be highly suited for global proteome analysis, higher intensities were obtained for high-abundant nucleic acid-associated protein complexes, like the ribosome and histone proteins, using guanidine hydrochloride. Importantly, we show for the first time that the observable total proteome mass of a sample strongly depends on the sample preparation protocol, with some protocols resulting in a significant underestimation of protein mass due to incomplete protein extraction of biased protein groups. Furthermore, we demonstrate that some of the observed abundance biases can be overcome by incorporating a nuclease treatment step or, alternatively, a correction factor for complementary sample preparation approaches.

Nicotine Self-Administration, Extinction Responding and Reinstatement in Adolescent and Adult Male Rats: Evidence Against a Biological Vulnerability to Nicotine Addiction during Adolescence

Initiation of smoking behavior typically occurs during adolescence and rarely occurs during adulthood. Despite this epidemiological evidence, relatively little is known about possible neurobiological differences in the response to nicotine in adolescents that might make them more vulnerable to nicotine addiction. In the current study, we assessed nicotine self-administration under fixed ratio (FR) and progressive ratio (PR) reinforcement schedules in adolescent (postnatal day (P) 33-35) and adult (P91-94) rats. We then assessed extinction and reinstatement of nicotine seeking in adulthood in rats that initiated nicotine self-administration during either adolescence or adulthood. Nicotine self-administration (0.03 mg/kg/infusion, i.v.) was higher in adult rats than in adolescent rats under FR5 and PR reinforcement schedules; no age differences in nicotine self-administration were observed under FR1 or FR2 reinforcement schedules. In contrast, saccharin self-administration under FR5 and PR reinforcement schedules was similar in both age groups, potentially ruling out age differences in general performance. Rats that initiated nicotine self-administration as adults demonstrated a greater resistance to extinction of nicotine taking behavior when saline was substituted for nicotine than rats that initiated self-administration as adolescents. Reinstatement of nicotine seeking following nicotine priming injections (0.075, 0.15, 0.3 mg/kg, s.c.) was independent of the age of onset of nicotine self-administration. The present data from established rat models of drug self-administration and drug relapse suggest that nicotine is less reinforcing in adolescent compared with adult rats and that processes other than the reinforcing effects of nicotine may be involved in the greater susceptibility to smoking during the adolescent developmental stage.

Music increases frontal EEG coherence during verbal learning

Anecdotal and some empirical evidence suggests that music can enhance learning and memory. However, the mechanisms by which music modulates the neural activity associated with learning and memory remain largely unexplored. We evaluated coherent frontal oscillations in the electroencephalogram (EEG) while subjects were engaged in a modified version of Rey's Auditory Verbal Learning Test (AVLT). Subjects heard either a spoken version of the AVLT or the conventional AVLT word list sung. Learning-related changes in coherence (LRCC) were measured by comparing the EEG during word encoding on correctly recalled trials to the immediately preceding trial on which the same word was not recalled. There were no significant changes in coherence associated with conventional verbal learning. However, musical verbal learning was associated with increased coherence within and between left and right frontal areas in theta, alpha, and gamma frequency bands. It is unlikely that the different patterns of LRCC reflect general performance differences; the groups exhibited similar learning performance. The results suggest that verbal learning with a musical template strengthens coherent oscillations in frontal cortical networks involved in verbal encoding.

Performance Effects of Formal Modeling Language Differences: A Combined Abstraction Level and Construct Complexity Analysis

Understanding data-modeling performance can provide valuable lessons for the selection, training, research, and development of data models. Data modeling is the process of transforming expressions in loose natural language communications into formal diagrammatic or tabular expressions. While researchers generally agree that abstraction levels can be used to explain general performance differences across models, empirical studies have reported many construct level results that cannot be explained. To explore further explanations, we develop a set of model-specific construct complexity values based on both theoretical and empirical support from complexity research in databases and other areas. We find that abstraction levels and complexity values together are capable of providing a consistent explanation of laboratory experiment data. In our experiment, data were drawn from three models: the relational model, the extended-entity-relationship model, and the object-oriented model. With the newly developed complexity measures, a consistent explanation can be made for findings from other studies which provide sufficient model details for complexity values to be calculated.

The use of virtual environments based on a modification of the computer game Quake III Arena® in psychological experimenting

We investigated whether newly developed virtual 3D environments (VEs) based on a modification of the computer game Quake III Arena^(R) are suitable for psychological experimenting. Internal validity of data collected in VEs may be threatened due to a priori individual differences in general performance in VE navigation and in susceptibility to cybersickness. The main question was whether individual differences in performance can be diminished by means of training. Additionally, the susceptibility of different subsamples to cybersickness when moving within VEs was examined. 85 participants took part in an experiment where they had to fulfill simple tasks in three VEs. Navigation performance was measured as the time participants needed to make their way through the VEs. Differences in navigation performance between different levels of experience were diminished by training, indicating that internal validity can be obtained. A classification tree reveals that game-inexperienced female participants aged over 31 years have the highest risk of experiencing cybersickness. VEs based on modifications of computer games seem to be an extremely promising and inexpensive possibility for the administration of psychological experiments.