Metacognitive Performance Research Articles

Thinking Metacognitively: Metacognitive Skills and Science Performance

The presented study aims to identify the relations between metacognitive skills and science performance. Data were collected from 211 Romanian adolescents in the seventh and eighth grades, who completed the Junior Metacognitive Awareness Inventory (the version for 5th- 9th grades). The results indicate that adolescents generally use metacognitive skills when learning science subjects and that some metacognitive skills are associated with better performance in science. Nevertheless, adolescents seem to encounter difficulties in using diagrams and pictures that facilitate the learning process, in evaluating the outcomes of their learning process and in using different learning strategies, in accordance with specific learning situations. Given the importance of metacognitive skills in science performance, we argue that it is essential for teachers to understand how to develop a culture of metacognition in science classrooms.

Knowledge and regulation of cognition in college science students

The research focused on three issues in college science students: whether there was empirical support for the two factor (knowledge of cognition and regulation of cognition) view of metacognition, whether the two factors were related to each other, and whether either of the factors was related to empirical measures of cognitive and metacognitive performance. To test the current conceptualisation of metacognition that assumes two main factors confirmatory factor analysis (CFA) was performed. AMOS software was used for performing CFA. Two experiments on 61 Premedical and 80 Medical Engineering Students supported the two factor model. Factors were correlated. Further experiments (Pearson's Correlation) reported a number of statistically significant relationships among knowledge of cognition, regulation of cognition, pre-test post-test judgements ability and performance. Strategies for the enhancement of students' metacognition were discussed.

Dissociations and suboptimalities in metacognitive performance due to unbalanced weighting of perceptual evidence can be partially remediated by task instruction and performance feedback

Dissociations and suboptimalities in metacognitive performance due to unbalanced weighting of perceptual evidence can be partially remediated by task instruction and performance feedback

The Effect of Age and Socio-Cultural Factors on Self-Rated Well-Being and Metacognitive and Mnestic Efficiency Among Healthy Elderly People

The aim of the present research was to investigate the effect of cross-cultural and age-related factors on self-referent metacognitive efficiency, psychological well-being, and mnestic performance in late adulthood. Ninety-three healthy adults recruited in individualistic northwest Italian and collectivistic Sardinian contexts were respectively assigned to the Old (i.e., 65–74 years) and Very Old (i.e., ≥ 75 years) groups and were individually administered a battery of well-being and metacognitive measures and working memory tasks. A series of MANOVAs was carried out on well-being and metacognitive measures and working memory tasks. Sardinians showed greater levels of perceived well-being, less marked psychological distress, and more preserved mnestic functions than the controls from the northwest Italian context. Moreover, participants from the Old group self-referred more coping strategies, emotional competencies, and personal satisfaction, and less depressive symptoms. Then, a hierarchical linear regressions where different socio-demographic, working memory metacognitive and social desirability measures were used as predictors of general psychological well-being shows that socio cultural context, social desirability, visuo-spatial sequential working memory and metamemory measures predict perceived well-being. Socio-cultural contexts emphasizing the positive social role of the elderly seem to promote psychological well-being, that is, life quality in late adulthood.

Metacognitive scaffolds improve self-judgments of accuracy in a medical intelligent tutoring system

In this study, we examined the effect of two metacognitive scaffolds on the accuracy of confidence judgments made while diagnosing dermatopathology slides in SlideTutor. Thirty-one (N = 31) first- to fourth-year pathology and dermatology residents were randomly assigned to one of the two scaffolding conditions. The cases used in this study were selected from the domain of Nodular and Diffuse Dermatitides. Both groups worked with a version of SlideTutor that provided immediate feedback on their actions for two hours before proceeding to solve cases in either the Considering Alternatives or Playback condition. No immediate feedback was provided on actions performed by participants in the scaffolding mode. Measurements included learning gains (pre-test and post-test), as well as metacognitive performance, including Goodman-Kruskal Gamma correlation, bias, and discrimination. Results showed that participants in both conditions improved significantly in terms of their diagnostic scores from pre-test to post-test. More importantly, participants in the Considering Alternatives condition outperformed those in the Playback condition in the accuracy of their confidence judgments and the discrimination of the correctness of their assertions while solving cases. The results suggested that presenting participants with their diagnostic decision paths and highlighting correct and incorrect paths helps them to become more metacognitively accurate in their confidence judgments.

The neurocognitive basis of insight into illness in anorexia nervosa: A pilot metacognitive study

The primary goal of the present study was to explore the neuropsychological basis of insight into illness in anorexia nervosa by evaluating its differential and joint links with cognitive vs. metacognitive performance. Participants in the study were 25 women with anorexia nervosa (AN) and 25 healthy comparisons (HC). All participants completed a computerized version of the Wisconsin Card Sorting Task (WCST) and the Computerized Body-Size Discrimination task (CBSD). In addition to the standard administration of the tasks, subjects were also asked to rate their level of confidence in the correctness of each sort and to choose whether they wanted each sort to be “counted” toward their overall performance score on the test. Insight into illness in the AN group was assessed with the Scale of Unawareness of Mental Disorder (SUMD). Prediction of poor insight was significantly improved when adding the new, free-choice metacognitive measures to the conventional measures in both tasks, but not the other way around. These preliminary results suggest that metacognition might be an important mediator between basic cognitive deficits and poor insight and that it might be even more relevant to poor insight than cognitive deficits per se.

Caractéristiques et impact des déficits métacognitifs dans la schizophrénie. Revue de la littérature

The aim of this review of the literature is to summarise the definitions of metacognition, the measurement tools, the results of studies investigating metacognition in persons with schizophrenia and the therapeutic perspectives. This review is based upon a selection of articles identified using a PubMed search containing the terms "schizophrenia" and "metacognition". Cognitive deficits are present in 75 to 85% of persons with schizophrenia. According to the disability model of the World Health Organization, these cognitive deficits have an impact on social functioning, community integration and quality of life. However, heterogeneous results have been obtained by studies exploring the functional impact of cognitive deficits, suggesting that there is no direct relationship between these two characteristics. One possible explanation is that subjective factors, notably metacognition, may play an intermediate role moderating the link between cognitive deficits and functional impairment. Metacognition is defined as the evaluation and regulation of its own cognitive processes. The evaluation (or monitoring) monitors the accuracy and reliability of the cognitive task performance. Regulation (or control) promotes behavioural adjustment. Studies carried out in persons with schizophrenia show that most of them experience deficits in metacognitive performance. These metacognitive deficits are thought to be a key barrier to functioning in schizophrenia. Measurement tools are classified into two types: "independent" measurement of the cognitive task and "on line" measurements performed during the cognitive task. The subjective scale to investigate cognition in schizophrenia (SSTIC) and the metacognitive assessment scale (MAS) are two examples of questionnaires measuring metacognition independently of the cognitive task. Online measurements assess the metacognitive "monitoring" by asking the subject to evaluate between 0 and 100% of his/her degree of confidence in his/her response to a question. The metacognitive "control" is assessed by asking the subject to validate his/her answer. Convergent findings are reported by studies exploring metacognitive persons in people with schizophrenia. Dissociation between metacognitive monitoring and metacognitive control has been reported. Regarding metamemory, which has been currently the most studied area, no difference is observed between persons with schizophrenia and controls with respect to the metamemory judgement. However, subgroups of persons with schizophrenia differ significantly from controls: they are over-confident in their response if it is incorrect and they estimate more frequently than the controls if they do not know when their answer is correct. The relationships between metacognitive and cognitive deficits are complex in persons with schizophrenia, with poor matching between subjective and objective deficits. Several studies have reported that metacognitive difficulties strongly interfere with social functioning. It has been suggested that metacognitive deficits more strongly predict community functioning in persons with schizophrenia than cognitive deficits. Metacognitive skills may hence be viewed as a key factor in translating cognitive performance skills in daily life. These data suggest that remediation programs specifically targeting metacognitive deficits have to be further developed.

Benefits of Order: The Influence of Item Sequencing on Metacognition in Moderate and Severe Traumatic Brain Injury

The ability to appraise one's own ability has been found to have an important role in the recovery and quality of life of clinical populations. Examinee and task variables have been found to influence metacognition in healthy students; however the effect of these variables on the metacognitive accuracy of adults with neurological insult, such as traumatic brain injury (TBI), remains unknown. Twenty-two adults with moderate and severe TBI and a matched sample of healthy adults participated in this study examining the influence of item sequencing on metacognitive functioning. Retrospective confidence judgments were collected while participants completed a modified version of the Matrix Reasoning subtest. Significant influence of item sequence order was found, revealing better metacognitive abilities and performance when participants completed tasks where item difficulty progressed in order from easy to difficult. We interpret these findings to suggest that the sequencing of item difficulty offers "anchors" for gauging and adjusting to task demands.

Metacognitive Performance, the Tip-of-Tongue Experience, Is Not Disrupted in Parkinsonian Patients

The present study investigated whether a form of metamemory, the tip-of-tongue phenomenon (TOT), was affected in patients with Parkinson's disease (PD). The PD patient (n = 22), age-matched elderly control (n = 22), and college student control (n = 46) groups were compared on a motor timing task and TOT measures. Motor timing was assessed using a cued hand-clapping task, whereas TOT was assessed using general knowledge questions. The results indicated that motor timing was significantly impaired in the PD group relative to both control groups. However, all of the TOT metacognitive measures: frequency, strength, and accuracy were statistically equivalent between the PD patients and elderly control groups, both of whom showed significantly better memory performance than college controls. These findings demonstrate that TOT metamemory is not compromised in PD patients, and that further insight into TOT mechanisms in PD may prove helpful in developing novel intervention strategies to enhance memory and general cognitive functions in these patients.

Child and adult witnesses: the effect of repetition and invitation-probes on free recall and metamemory realism

Witnesses’ event recall and the realism in their evaluation of the correctness of their recall are of great importance in forensic processes. These issues were investigated in the present study by use of calibration methodology. More specifically, we analyzed the effects of two recalls of the same event (repetition) and of probes (non-informative follow-up questions at recall) on 9–11 year-old children’s and adults’ open free recall and the degree of realism in the participants’ confidence judgments of the correctness of the recall after they had seen a short video clip. The findings were that repetition resulted in more units recalled both for children and for adults, and in that the children showed higher overconfidence compared with one recall, but not the adults. Moreover, when only the statements in the repetition conditions that were recalled twice were included in the analysis, higher confidence was found for the children (independent of an increase in the proportion correct statements of all statements) but not for the adults. Probing increased the number of units recalled for both children and adults, decreased the children’s proportion correct statements but not the adults’, decreased both children’s and adults’ confidence and increased the children’s overconfidence, but not the adults’. Finally, the combination of two recalls and probing disrupted the children’s but not the adults’ metacognitive performance.

Relating inter-individual differences in metacognitive performance on different perceptual tasks

Human behavior depends on the ability to effectively introspect about our performance. For simple perceptual decisions, this introspective or metacognitive ability varies substantially across individuals and is correlated with the structure of focal areas in prefrontal cortex. This raises the possibility that the ability to introspect about different perceptual decisions might be mediated by a common cognitive process. To test this hypothesis, we examined whether inter-individual differences in metacognitive ability were correlated across two different perceptual tasks where individuals made judgments about different and unrelated visual stimulus properties. We found that inter-individual differences were strongly correlated between the two tasks for metacognitive ability but not objective performance. Such stability of an individual’s metacognitive ability across different perceptual tasks indicates a general mechanism supporting metacognition independent of the specific task.

A Preliminary Exploration of on-Line Study Question Performance and Response Certitude as Predictors of Future Examination Performance

This research evaluated an online study task intended to improve the study metacognition and examination performance of inexperienced college students. Existing research has commonly operationalized metacognition as the accuracy of examination score predictions. This research made use of the average discrepancy between rated confidence in individual study question responses and the accuracy of the responses to these questions as a second way to assess metacognition. Study questions accuracy, average study question confidence discrepancy, and examination predictions were contrasted as predictors of examination performance. Study question accuracy and examination predictions were significant predictors of performance. The usefulness of the accuracy of confidence ratings in predicting examination performance may have been diminished by the decreasing use of the online study questions by those who performed most poorly on examinations. Those students who ended up scoring in the bottom third on course examinations made significantly less use of the study system after the first examination. The results indicate that performance on study questions offers a useful way to predict future examination performance. The accuracy of rated confidence did improve across examinations possibly indicating students become more aware of the accuracy of their understanding and the variable may have potential value if student compliance with the proposed use of online study questions can be improved.

Factors affecting feeling-of-knowing in a medical intelligent tutoring system: the role of immediate feedback as a metacognitive scaffold

Previous studies in our laboratory have shown the benefits of immediate feedback on cognitive performance for pathology residents using an intelligent tutoring system (ITS) in pathology. In this study, we examined the effect of immediate feedback on metacognitive performance, and investigated whether other metacognitive scaffolds will support metacognitive gains when immediate feedback is faded. Twenty-three participants were randomized into intervention and control groups. For both groups, periods working with the ITS under varying conditions were alternated with independent computer-based assessments. On day 1, a within-subjects design was used to evaluate the effect of immediate feedback on cognitive and metacognitive performance. On day 2, a between-subjects design was used to compare the use of other metacognitive scaffolds (intervention group) against no metacognitive scaffolds (control group) on cognitive and metacognitive performance, as immediate feedback was faded. Measurements included learning gains (a measure of cognitive performance), as well as several measures of metacognitive performance, including Goodman-Kruskal gamma correlation (G), bias, and discrimination. For the intervention group, we also computed metacognitive measures during tutoring sessions. Results showed that immediate feedback in an intelligent tutoring system had a statistically significant positive effect on learning gains, G and discrimination. Removal of immediate feedback was associated with decreasing metacognitive performance, and this decline was not prevented when students used a version of the tutoring system that provided other metacognitive scaffolds. Results obtained directly from the ITS suggest that other metacognitive scaffolds do have a positive effect on G and discrimination, as immediate feedback is faded. We conclude that immediate feedback had a positive effect on both metacognitive and cognitive gains in a medical tutoring system. Other metacognitive scaffolds were not sufficient to replace immediate feedback in this study. However, results obtained directly from the tutoring system are not consistent with results obtained from assessments. In order to facilitate transfer to real-world tasks, further research will be needed to determine the optimum methods for supporting metacognition as immediate feedback is faded.

Sources of bias in the Goodman–Kruskal gamma coefficient measure of association: Implications for studies of metacognitive processes.

In many cognitive, metacognitive, and perceptual tasks, measurement of performance or prediction accuracy may be influenced by response bias. Signal detection theory provides a means of assessing discrimination accuracy independent of such bias, but its application crucially depends on distributional assumptions. The Goodman-Kruskal gamma coefficient, G, has been proposed as an alternative means of measuring accuracy that is free of distributional assumptions. This measure is widely used with tasks that assess metamemory or metacognition performance. The authors demonstrate that the empirically determined value of G systematically deviates from its actual value under realistic conditions. A distribution-specific variant of G, called G-sub(c), is introduced to show why this bias arises. The findings imply that caution is needed when using G as a measure of accuracy, and alternative measures are recommended.

Multiple demonstrations of metacognition in nonhumans: Converging evidence or multiple mechanisms?

Metacognition allows one to monitor and adaptively control cognitive processes. Reports from the last 15 years show that when given the opportunity, nonhuman animals selectively avoid taking difficult tests of memory or perception, collect more information if needed before taking tests, or "gamble" more food reward on correct than on incorrect responses in tests of memory and perception. I review representative examples from this literature, considering the sufficiency of four classes of mechanism to account for the metacognitive performance observed. This analysis suggests that many of the demonstrations of metacognition in nonhumans can be explained in terms of associative learning or other mechanisms that do not require invoking introspection or access to private mental states. Consideration of these accounts may prompt greater appreciation of the diversity of metacognitive phenomena and may inform theoretical positions about the nature of the mental representations underlying metacognition.

Metacognitive Performances of Hearing Students and of Students who are Deaf and Hard‐of‐Hearing on Two Types of Measures: Visual–voiced and visual–visual stimuli

A small sample of 20 hearing students and 20 students who are deaf and hard‐of‐hearing participated in this study, which compared their performances on two measures of metacognition. The first measure required participants to visually analyse real‐life pictures and then to choose a response from four options (voiced or signed) indicating which was the best explanation of what was depicted. The second measure required participants to look at five pictures and then to point to the picture that was different. Results identified no significant differences between the performances of the two groups of students on either measure. Males in both groups performed at comparable levels on the two measures, whereas females who were hearing and those who were deaf or hard‐of‐hearing performed significantly better on the visual–voiced measure than on the visual–visual measure. Limitations of this study and recommendations for future research are discussed.

Metacognition and Human Performance Improvement Originally published in 1988, PIQ 1.1

An understanding of the uses of metacognition provides a powerful tool toward developing quality and efficiency in task learning and performance. Metacognition is the executive controller of cognitive processes responsible both for self regulated learning and work performance outcomes. Comprehension monitoring and motivation are two prime components of metacognition which are responsible for commitment to, and definition of, goals, monitoring progress toward goals, and activating the appropriate thinking skills to achieve goals. Specific thinking skill categories of attention, organization, and elaboration are described with examples of how specific techniques in each category can optimize learning and job performance. Research on training of metacognitive skills through both detached and embedded skill-development programs is reviewed. In addition, ways to compensate for metacognitive skills when training is not cost-effective are described. The relationship between metacognitive skills and effective management of work performance is stressed.

The Interplay of Processing Efficiency and Working Memory with the Development of Metacognitive Performance in Mathematics

The present study outlines a specific three level hierarchy of the cognitive system and especially the relations of specific cognitive and metacognitive processes in mathematics. The emphasis is on the impact of the development of processing efficiency and working memory ability on the development of metacognitive abilities and mathematical performance. We had used instruments measuring pupils´ metacognitive ability, mathematical performance, working memory and processing efficiency. We administered them to 126 pupils (8-11 years old) three times, with breaks of 3-4 months between them. Results indicated that the development of each of the abilities was affected by the state of the others. Particularly, processing efficiency had a coordinator role on the growth of mathematical performance, while self-image, as a specific metacognitive ability, depended mainly on the previous working memory ability.

Visual Analyses and Discriminations: One Approach to Measuring Students' Metacognition

THE METACOGNITIVE performance of four groups of students was examined. The students' processes of visual analysis and discrimination of real-life pictures were used to measure metacognition. There were 61 participants: 18 hearing students, 18 deaf and hard of hearing students, 16 students with mild mental disabilities, and 9 students with physical disabilities. Analysis revealed no significant differences among hearing students, deaf and hard of hearing students, and students with physical disabilities. The performance of these three groups of students was significantly better than the performance of students with mild mental disabilities. It appears that students with mild mental disabilities encountered difficulties with pictures that required complex visual analyses and discriminations. These difficulties were manifested in a form of deficient simultaneous visual processing along with a low level of knowledge acquisition.

Cognition, Metacognition, and Achievement of College Students with Learning Disabilities

This study examined the way successful college students with LD compensated for their deficits in phonological processing. Successful was defined as average or above-average grades in college coursework. The study compared the cognitive and metacognitive performance of students with and without LD (N=40). Although achievement levels for both groups were comparable, students with LD scored significantly lower than students without LD in word reading, processing speed, semantic processing, and short-term memory. Differences were also found between groups in self-regulation and number of hours of studying. Results showed that students with LD compensated for their processing deficits by relying on verbal abilities, learning strategies, and help seeking.