Reliable Individual Differences Research Articles

Does Interference Between Intuitive Conceptions and Scientific Concepts Produce Reliable Inter-individual Differences? A Psychometric Analysis

AbstractStatement-verification studies indicate the coexistence of intuitive conceptions and scientific concepts within learners. The underlying assumption is that the intuitive conceptions typically built in childhood never disappear, but are co-activated with scientific concepts when we face relevant situations. This is visible in increased reaction times and error rates when confronting statements for which intuitive conceptions and scientific concepts disagree. Studies that have tried to relate individual differences in this phenomenon to other variables such as inhibition have yielded inconclusive results. In the present study, we examine the structure of individual differences in the statement-verification paradigm by Shtulman and Valcarcel (2012). Using factor analytic model comparisons, we find that there is little stable variation in individuals’ increases of reaction times and error rates across items covering scientific concepts from different domains, as well as across topics within domains. This finding suggests that a reason for inconsistent findings is the absence of stable individual differences in statement-verification tasks. One explanation for this finding is that the answer process draws more strongly on variable cognitive resources (e.g., content knowledge) than on more stable resources (e.g., inhibition ability). The occurrence and handling of interference between intuitive conceptions and scientific concepts appear to be driven by contextual factors rather than by stable cognitive processes. We discuss alternative explanations for the lack of reliable individual differences and implications for theories and the statistical modeling of cognitive pluralism.

Emotional event perception is related to lexical complexity and emotion knowledge

Inferring emotion is a critical skill that supports social functioning. Emotion inferences are typically studied in simplistic paradigms by asking people to categorize isolated and static cues like frowning faces. Yet emotions are complex events that unfold over time. Here, across three samples (Study 1 N = 222; Study 2 N = 261; Study 3 N = 101), we present the Emotion Segmentation Paradigm to examine inferences about complex emotional events by extending cognitive paradigms examining event perception. Participants were asked to indicate when there were changes in the emotions of target individuals within continuous streams of activity in narrative film (Study 1) and documentary clips (Study 2, preregistered, and Study 3 test-retest sample). This Emotion Segmentation Paradigm revealed robust and reliable individual differences across multiple metrics. We also tested the constructionist prediction that emotion labels constrain emotion inference, which is traditionally studied by introducing emotion labels. We demonstrate that individual differences in active emotion vocabulary (i.e., readily accessible emotion words) correlate with emotion segmentation performance.

Local but not global graph theoretic measures of semantic networks generalize across tasks.

"Dogs" are connected to "cats" in our minds, and "backyard" to "outdoors." Does the structure of this semantic knowledge differ across people? Network-based approaches are a popular representational scheme for thinking about how relations between different concepts are organized. Recent research uses graph theoretic analyses to examine individual differences in semantic networks for simple concepts and how they relate to other higher-level cognitive processes, such as creativity. However, it remains ambiguous whether individual differences captured via network analyses reflect true differences in measures of the structure of semantic knowledge, or differences in how people strategically approach semantic relatedness tasks. To test this, we examine the reliability of local and global metrics of semantic networks for simple concepts across different semantic relatedness tasks. In four experiments, we find that both weighted and unweighted graph theoretic representations reliably capture individual differences in local measures of semantic networks (e.g., how related pot is to pan versus lion). In contrast, we find that metrics of global structural properties of semantic networks, such as the average clustering coefficient and shortest path length, are less robust across tasks and may not provide reliable individual difference measures of how people represent simple concepts. We discuss the implications of these results and offer recommendations for researchers who seek to apply graph theoretic analyses in the study of individual differences in semantic memory.

Prosocial development throughout the toddlerhood: A person‐centred approach

AbstractAddressing the debate on whether there are reliable individual differences in toddler's prosociality, this study employed a person‐centred approach to investigate (1) profiles of instrumental helping, sharing and empathic helping at 22, 28 and 34 months, and (2) the predictive role of toddler's temperament (anger/frustration, impulsivity and inhibitory control) to these profiles. Variable‐centred analyses examined cross‐task and over time associations. Participants were 93 Dutch toddlers observed in standardised behavioural assessments at each wave. Parents rated their toddler's temperament at wave 1. Results revealed small but significant across‐task and over time associations of the prosocial behaviours and children were distinguished into three profile groups at 22 months (high prosocial, instrumental helper and low prosocial), three at 28 months (high, moderate and low) and two profiles at 34 months (high prosocial and instrumental and empathic helpers), with low to moderate membership stability across waves. For 34‐month‐olds, those in the high prosocial group were rated as being less impulsive compared to their peers in the helper group. These findings indicate reliable individual differences of prosociality exist at early ages with impulsivity as a potential precursor to these individual differences.

Reliability of individual differences in distractor suppression driven by statistical learning.

A series of recent studies has demonstrated that attentional selection is modulated by statistical regularities, even when they concern task-irrelevant stimuli. Irrelevant distractors presented more frequently at one location interfere less with search than distractors presented elsewhere. To account for this finding, it has been proposed that through statistical learning, the frequent distractor location becomes suppressed relative to the other locations. Learned distractor suppression has mainly been studied at the group level, where individual differences are treated as unexplained error variance. Yet these individual differences may provide important mechanistic insights and could be predictive of cognitive and real-life outcomes. In the current study, we ask whether in an additional singleton task, the standard measures of attentional capture and learned suppression are reliable and stable at the level of the individual. In an online study, we assessed both the within- and between-session reliability of individual-level measures of attentional capture and learned suppression. We show that the measures of attentional capture, but not of distractor suppression, are moderately stable within the same session (i.e., split-half reliability). Test-retest reliability over a 2-month period was found to be moderate for attentional capture but weak or absent for suppression. RT-based measures proved to be superior to accuracy measures. While producing very robust findings at the group level, the predictive validity of these RT-based measures is still limited when it comes to individual-level performance. We discuss the implications for future research drawing on inter-individual variation in the attentional biases that result from statistical learning.

Language Experience Predicts Eye Movements During Online Auditory Comprehension.

Experience-based theories of language processing suggest that listeners use the properties of their previous linguistic input to constrain comprehension in real time (e.g. MacDonald & Christiansen, 2002; Smith & Levy, 2013; Stanovich & West, 1989; Mishra, Pandey, Singh, & Huettig, 2012). This project investigates the prediction that individual differences in experience will predict differences in sentence comprehension. Participants completed a visual world eye-tracking task following Altmann and Kamide (1999) which manipulates whether the verb licenses the anticipation of a specific referent in the scene (e.g. The boy will eat/move the cake). Within this paradigm, we ask (1) are there reliable individual differences in language-mediated eye movements during this task? If so, (2) do individual differences in language experience correlate with these differences, and (3) can this relationship be explained by other, more general cognitive abilities? Study 1 finds evidence that language experience predicts an overall facilitation in fixating the target, and Study 2 replicates this effect and finds that it remains when controlling for working memory, inhibitory control, phonological ability, and perceptual speed.

The Situated Assessment Method (SAM2): Establishing individual differences in habitual behavior.

From the perspectives of grounded, situated, and embodied cognition, we have developed a new approach for assessing individual differences. Because this approach is grounded in two dimensions of situatedness-situational experience and the Situated Action Cycle-we refer to it as the Situated Assessment Method (SAM2). Rather than abstracting over situations during assessment of a construct (as in traditional assessment instruments), SAM2 assesses a construct in situations where it occurs, simultaneously measuring factors from the Situated Action Cycle known to influence it. To demonstrate this framework, we developed the SAM2 Habitual Behavior Instrument (SAM2 HBI). Across three studies with a total of 442 participants, the SAM2 HBI produced a robust and replicable pattern of results at both the group and individual levels. Trait-level measures of habitual behavior exhibited large reliable individual differences in the regularity of performing positive versus negative habits. Situational assessments established large effects of situations and large situation by individual interactions. Several sources of evidence demonstrated construct and content validity for SAM2 measures of habitual behavior. At both the group and individual levels, these measures were associated with factors from the Situated Action Cycle known to influence habitual behavior in the literature (consistency, automaticity, immediate reward, long-term reward). Regressions explained approximately 65% of the variance at the group level and a median of approximately 75% at the individual level. SAM2 measures further exhibited well-established interactions with personality measures for self-control and neuroticism. Cognitive-affective processes from the Situated Action Cycle explained nearly all the variance in these interactions. Finally, a composite measure of habitualness established habitual behaviors at both the group and individual levels. Additionally, a composite measure of reward was positively related to the composite measure of habitualness, increasing with self-control and decreasing with neuroticism.

Poorer White Matter Microstructure Predicts Slower and More Variable Reaction Time Performance: Evidence for a Neural Noise Hypothesis in a Large Lifespan Cohort.

Most prior research has focused on characterizing averages in cognition, brain characteristics, or behavior, and attempting to predict differences in these averages among individuals. However, this overwhelming focus on mean levels may leave us with an incomplete picture of what drives individual differences in behavioral phenotypes by ignoring the variability of behavior around an individual's mean. In particular, enhanced white matter (WM) structural microstructure has been hypothesized to support consistent behavioral performance by decreasing Gaussian noise in signal transfer. Conversely, lower indices of WM microstructure are associated with greater within-subject variance in the ability to deploy performance-related resources, especially in clinical populations. We tested a mechanistic account of the "neural noise" hypothesis in a large adult lifespan cohort (Cambridge Centre for Ageing and Neuroscience) with over 2500 adults (ages 18-102; 1508 female; 1173 male; 2681 behavioral sessions; 708 MRI scans) using WM fractional anisotropy to predict mean levels and variability in reaction time performance on a simple behavioral task using a dynamic structural equation model. By modeling robust and reliable individual differences in within-person variability, we found support for a neural noise hypothesis (Kail, 1997), with lower fractional anisotropy predicted individual differences in separable components of behavioral performance estimated using dynamic structural equation model, including slower mean responses and increased variability. These effects remained when including age, suggesting consistent effects of WM microstructure across the adult lifespan unique from concurrent effects of aging. Crucially, we show that variability can be reliably separated from mean performance using advanced modeling tools, enabling tests of distinct hypotheses for each component of performance.SIGNIFICANCE STATEMENT Human cognitive performance is defined not just by the long-run average, but trial-to-trial variability around that average. However, investigations of cognitive abilities and changes during aging have largely ignored this variability component of behavior. We provide evidence that white matter (WM) microstructure predicts individual differences in mean performance and variability in a sample spanning the adult lifespan (18-102). Unlike prior studies of cognitive performance and variability, we modeled variability directly and distinct from mean performance using a dynamic structural equation model, which allows us to decouple variability from mean performance and other complex features of performance (e.g., autoregression). The effects of WM were robust above the effect of age, highlighting the role of WM in promoting fast and consistent performance.

Synchrony to a beat predicts synchrony with other minds

Synchrony has been used to describe simple beat entrainment as well as correlated mental processes between people, leading some to question whether the term conflates distinct phenomena. Here we ask whether simple synchrony (beat entrainment) predicts more complex attentional synchrony, consistent with a common mechanism. While eye-tracked, participants listened to regularly spaced tones and indicated changes in volume. Across multiple sessions, we found a reliable individual difference: some people entrained their attention more than others, as reflected in beat-matched pupil dilations that predicted performance. In a second study, eye-tracked participants completed the beat task and then listened to a storyteller, who had been previously recorded while eye-tracked. An individual’s tendency to entrain to a beat predicted how strongly their pupils synchronized with those of the storyteller, a corollary of shared attention. The tendency to synchronize is a stable individual difference that predicts attentional synchrony across contexts and complexity.

The Relation between Ensemble Coding of Length and Orientation Does Not Depend on Spatial Attention

Most people are good at estimating summary statistics for different features of groups of objects. For instance, people can selectively attend to different features of a group of lines and report ensemble properties such as the mean length or mean orientation and there are reliable individual differences in such ensemble judgment abilities. Our recent study found decisive evidence in support of a correlation between the errors on mean length and mean orientation judgments (r = 0.62). The present study investigates one possible mechanism for this correlation. The ability to allocate spatial attention to single items varies across individuals, and in the recent study, this variability could have contributed to both judgments because the location of lines was unpredictable. Here, we replicate this prior work with arrays of lines with fully predictable spatial locations, to lower the contribution of the ability to distribute attention effectively over all items in a display. We observed a strong positive correlation between errors on the length and orientation averaging tasks (r = 0.65). This provides evidence against individual differences in spatial attention as a common mechanism supporting mean length and orientation judgments. The present result aligns with the growing evidence for at least one ensemble-specific ability that applies across different kinds of features and stimuli.

Shooter biases and stereotypes among police and civilians

The present research assesses potential correlates of discriminatory police behavior, comparing police and civilian participants in a first person shooter task (FPST) as well as on various self-report measures of intergroup contact, intergroup attitudes, and ideological beliefs in three preregistered studies. Study 1 (N = 330), using a FPST with a short response window (630 ms), did not observe shooter biases in reaction times, error rates and signal detection parameters in neither police nor civilian participants. Study 2a (N = 290), using a longer response window (850 ms), observed a shooter bias in reaction times, error rates, and response criterion in both civilian and police participants. These shooter biases were largely driven by faster reactions, fewer errors, and more liberal shoot decisions for armed Arab (vs. White) targets. Study 2b (N = 191; 850 ms response window) closely replicated shooter biases in reaction times, error rates, and response criterion in a sample of civilian online participants. Across studies, we observed similar results in the shooter task for police and civilian samples. Furthermore, both police and civilian participants expressed anti-Muslim and anti-Arab attitudes across a variety of self-report measures. However, compared to civilians, police participants reported higher levels of anti-Muslim attitudes on some measures as well as higher levels of social dominance orientation, which might pose additional risk factors for discriminatory behavior. Lastly, while we observed reliable individual differences in self-reported intergroup attitudes, ideologies, and intergroup contact, none of these characteristics correlated with shooter biases.

Design thinking competence as self-perceived by nursing students in Taiwan: A cross-sectional study

BackgroundCompetence in design thinking plays a pivotal role when undertaking innovative problem-solving. Our knowledge on nursing students' self-perceived design thinking competence, however, is noticeably lacking, particularly in Taiwan. ObjectTo examine Taiwanese nursing students' self-perceived competence in design thinking. DesignDescriptive, cross-sectional, quantitative study. ParticipantsOne hundred and one nursing students enrolled in the interdisciplinary capstone courses, which were jointly offered to industrial design students, as part of a 4-year nursing program at a science and technology university in northern Taiwan. MethodsSelf-reported questionnaire data were collected from students, including their demographics and self-perceived competence in design thinking as measured by the Creative Synthesis Inventory and the Design Thinking Traits Questionnaire between January 2020 and January 2021. ResultsDistinctive and reliable individual differences were found in nursing students' self-perceived competence in design thinking. In addition, students perceived a significantly higher creative synthesis skill of discovery in developing an understanding of potential users and a significantly lower design thinking trait of optimism, not backing down from challenging problems. Finally, greater perceived competence in creative synthesis skills were significantly correlated with greater perceived competence in all design thinking traits, except the trait of optimism. ConclusionsResults indicated that significant individual differences exist in Taiwanese nursing students' self-perceived design thinking competence, suggesting opportunities for helping students with lower perceived competence. Overall, Taiwanese students believed themselves to be less skilled in visualization, prototyping, and evaluation as well as lacking an attribute of optimism when encountering challenging problems. Therefore, as informed by the design thinking framework, nursing schools should focus on developing strategies through training and practice to foster creative synthesis skills and designer traits in students, particularly targeting those who self-perceived as less competent and those skills and traits self-perceived as weaknesses.

Individual differences in looking at persons in scenes.

Individuals freely viewing complex scenes vary in their fixation behavior. The most prominent and reliable dimension of such individual differences is the tendency to fixate faces. However, much less is known about how observers distribute fixations across other body parts of persons in scenes and how individuals may vary in this regard. Here, we aimed to close this gap. We expanded a popular annotated stimulus set (Xu, Jiang, Wang, Kankanhalli, & Zhao, 2014) with 6,365 hand-delineated pixel masks for the body parts of 1,136 persons embedded in 700 complex scenes, which we publish with this article (https://osf.io/ynujz/). This resource allowed us to analyze the person-directed fixations of 103 participants freely viewing these scenes. We found large and reliable individual differences in the distribution of fixations across person features. Individual fixation tendencies formed two anticorrelated clusters, one for the eyes, head, and the inner face and one for body features (torsi, arms, legs, and hands). Interestingly, the tendency to fixate mouths was independent of the face cluster. Finally, our results show that observers who tend to avoid person fixations in general, particularly do so for the face region. These findings underscore the role of individual differences in fixation behavior and reveal underlying dimensions. They are further in line with a recently proposed push-pull relationship between cortical tuning for faces and bodies. They may also aid the comparison of special populations to general variation.

Characteristic fixation biases in Super-Recognizers.

Neurotypical observers show large and reliable individual differences in gaze behavior along several semantic object dimensions. Individual gaze behavior toward faces has been linked to face identity processing, including that of neurotypical observers. Here, we investigated potential gaze biases in Super-Recognizers (SRs), individuals with exceptional face identity processing skills. Ten SRs, identified with a novel conservative diagnostic framework, and 43 controls freely viewed 700 complex scenes depicting more than 5000 objects. First, we tested whether SRs and controls differ in fixation biases along four semantic dimensions: faces, text, objects being touched, and bodies. Second, we tested potential group differences in fixation biases toward eyes and mouths. Finally, we tested whether SRs fixate closer to the theoretical optimal fixation point for face identification. SRs showed a stronger gaze bias toward faces and away from text and touched objects, starting from the first fixation onward. Further, SRs spent a significantly smaller proportion of first fixations and dwell time toward faces on mouths but did not differ in dwell time or first fixations devoted to eyes. Face fixation of SRs also fell significantly closer to the theoretical optimal fixation point for identification, just below the eyes. Our findings suggest that reliable superiority for face identity processing is accompanied by early fixation biases toward faces and preferred saccadic landing positions close to the theoretical optimum for face identification. We discuss future directions to investigate the functional basis of individual fixation behavior and face identity processing ability.

It’s Not You, It’s Me: Some Speakers Elicit Structural Priming More Reliably Than Others

Linguistic convergence – the alignment of your linguistic choices with those of your conversation partner – is a well-known phenomenon. An unresolved question about linguistic convergence concerns whether there are individual differences in convergence. Do some people converge with their partner more reliably than others, and do some people elicit convergence more reliably than others? We explored whether some speakers elicit a type of linguistic convergence known as structural priming more reliably than others. Our experimenters called businesses and asked questions such as, At/What time do you close? We demonstrated a structural priming effect (e.g., participants were more likely to use a preposition in their response when the question contained a preposition). We also found that some speakers elicited stronger priming effects than others, and that this tendency was reliable. Our findings suggest that there are reliable individual differences in the extent to which speakers elicit structural matching from their partners.

Across demographics and recent history, most parents sing to their infants and toddlers daily.

Music is universally prevalent in human society and is a salient component of the lives of young families. Here, we studied the frequency of singing and playing recorded music in the home using surveys of parents with infants (N = 945). We found that most parents sing to their infant on a daily basis and the frequency of infant-directed singing is unrelated to parents' income or ethnicity. Two reliable individual differences emerged, however: (i) fathers sing less than mothers and (ii) as infants grow older, parents sing less. Moreover, the latter effect of child age was specific to singing and was not reflected in reports of the frequency of playing recorded music. Last, we meta-analysed reports of the frequency of infant-directed singing and found little change in its frequency over the past 30 years, despite substantial changes in the technological environment in the home. These findings, consistent with theories of the psychological functions of music, in general, and infant-directed singing, in particular, demonstrate the everyday nature of music in infancy. This article is part of the theme issue 'Voice modulation: from origin and mechanism to social impact (Part I)'.

A striking take on mass inferences from collisions

Our everyday activities – e.g., packing groceries, building sandcastles – require knowledge about the physical properties of the objects and surfaces in our environments. We often learn about properties such as weight, hardness, and slipperiness by interacting with the world, but we also learn about latent physical properties by observing events. Among the best-studied examples is people’s ability to infer objects’ relative masses based on seeing them collide, and work on this front has shown that people’s inferences sometimes show marked biases. For example, when an incoming object strikes a stationary one, people consistently overestimate the mass of the incoming object. Why? Various accounts attribute the effect to heuristics that fail in certain conditions, simplified stimuli that lack realistic cues, or a characteristic of rational Newtonian decisions made under sensory uncertainty. Here we sought to disentangle these competing accounts by asking observers to judge the relative weights of bowling balls in videos of real collisions. Balls ranged from 6 to 16 pounds; subjects saw all possible pairings and reported whether the incoming ball or the initially static one was heavier. Under these realistic conditions, participants still consistently overestimated the incoming ball’s weight. We found reliable individual differences in the size of this bias, and in overall performance in weight discrimination. While weight discrimination performance was predictive of intuitive physics abilities in general (assessed with an independent task battery), bias in weight estimation showed no relationship, suggesting it is not a hindrance in other tasks. In a final experiment, we occluded cues in the videos that the purported heuristics would rely on, and we found it had little impact on overall weight discrimination or bias. Our results argue against accounts based on heuristics or oversimplified stimuli and support the idea that the bias is a characteristic of a well-tuned Newtonian system.

Are there Reliable Qualitative Individual Differences in Cognition? Probably Not.

Rouder and Haaf (2021, this issue) propose a focus shift toward qualitative individual differences in cognition and present a research toolkit for doing so. In this invited commentary, I will argue that the observation of qualitative individual differences may be no more than an indicator that more theoretical and empirical work needs to be done to identify the mechanisms and abilities underlying these individual differences in directionality. I will then move on to discuss how the toolkit can be used though to investigate one of the currently most central current topics in cognitive differential psychology, that is, the question over the existence of true quantitative individual differences in attentional control experimental effects. I conclude that, while highly valuable, no toolkit can save us from facing the challenging theoretical and conceptual questions in this area.

Cross-modal auditory priors drive the perception of bistable visual stimuli with reliable differences between individuals

It is a widely held assumption that the brain performs perceptual inference by combining sensory information with prior expectations, weighted by their uncertainty. A distinction can be made between higher- and lower-level priors, which can be manipulated with associative learning and sensory priming, respectively. Here, we simultaneously investigate priming and the differential effect of auditory vs. visual associative cues on visual perception, and we also examine the reliability of individual differences. Healthy individuals (N = 29) performed a perceptual inference task twice with a one-week delay. They reported the perceived direction of motion of dot pairs, which were preceded by a probabilistic visuo-acoustic cue. In 30% of the trials, motion direction was ambiguous, and in half of these trials, the auditory versus the visual cue predicted opposing directions. Cue-stimulus contingency could change every 40 trials. On ambiguous trials where the visual and the auditory cue predicted conflicting directions of motion, participants made more decisions consistent with the prediction of the acoustic cue. Increased predictive processing under stimulus uncertainty was indicated by slower responses to ambiguous (vs. non-ambiguous) stimuli. Furthermore, priming effects were also observed in that perception of ambiguous stimuli was influenced by perceptual decisions on the previous ambiguous and unambiguous trials as well. Critically, behavioural effects had substantial inter-individual variability which showed high test–retest reliability (intraclass correlation coefficient (ICC) > 0.78). Overall, higher-level priors based on auditory (vs. visual) information had greater influence on visual perception, and lower-level priors were also in action. Importantly, we observed large and stable differences in various aspects of task performance. Computational modelling combined with neuroimaging could allow testing hypotheses regarding the potential mechanisms causing these behavioral effects. The reliability of the behavioural differences implicates that such perceptual inference tasks could be valuable tools during large-scale biomarker and neuroimaging studies.

Cognitive efficiency beats top-down control as a reliable individual difference dimension relevant to self-control

Top-down control of responses is a key construct in cognitive science that is thought to be critical for self-control. It is typically measured by subtracting performance in experimental conditions in which top-down control is theoretically present against performance in matched conditions in which it is assumed to be absent. Recently, however, subtraction-based metrics of top-down control have been criticized for having low test-retest reliability, weak intercorrelations, and little relation to self-report measures of self-control. Concurrently, there is growing evidence that task-general cognitive efficiency, indexed by the drift rate parameter of the diffusion model (Ratcliff, 1978), constitutes a cohesive, reliable individual difference dimension relevant to self-control. However, no previous studies have directly compared latent factors for top-down control (derived from subtraction metrics) with factors for task-general efficiency “head-to-head” in the same sample in terms of their cohesiveness, temporal stability, and relation to self-control. In this re-analysis of a large open data set (Eisenberg et al., 2019; N = 522), we find that top-down control metrics fail to form cohesive latent factors, that the resulting factors have poor temporal stability, and that they exhibit tenuous connections to questionnaire measures of self-control. In contrast, cognitive efficiency measures—drawn from conditions of the same tasks that both are, and are not, assumed to demand top-down control—form a robust, temporally stable factor that correlates with questionnaire measures of self-control. These findings suggest that task-general efficiency is a central individual difference dimension relevant to self-control. Moreover, they go beyond recent measurement-based critiques of top-down control metrics, and instead suggest problems with key theoretical assumptions that have long guided this research paradigm.