Judgments Of Learning Research Articles

Contribution of Metacognitive Questions to Accuracy of Judgment of Learning in a Digital Environment

Primary school pupils have difficulty making accurate judgments of learning (JOL) in a digital environment. In two studies, we examined the contribution of metacognitive self-questioning to JOL accuracy in the course of reading literacy (Study 1) and mathematical literacy (Study 2) digital learning programs. Both studies comprised a six-session intervention. In each session fifth-grade students studied a short text (Study 1, N=65) or story containing mathematical components (Study 2, N = 72), then judged their comprehension by predicting their performance before completing a test. For the experimental groups, metacognitive questioning was incorporated into the study materials. In both studies the experimental groups improved over the six sessions in both performance and calibration (i.e., reducing the gap between judgment and performance). The findings highlight the contribution of metacognitive support to improved performance and judgment accuracy and strengthen the case for incorporating metacognitive practices when teaching literacy in a digital environment.

Judgments of learning (JOLs) impact item memory but not source memory: Insights into JOL reactivity using a multinomial model.

Past research has evaluated participants' understanding of their memory by soliciting judgments of learning (JOLs). Importantly, JOLs sometimes change memory for the judged material, leading to JOL reactivity. The cue-strengthening account (Soderstrom et al., 2015) and changed-goal account (Mitchum et al., 2016) propose different mechanisms that lead to JOL reactivity. In the present study, we collected measures that can provide further insight into these mechanisms. Specifically, participants studied related and unrelated word pairs in different colored fonts for a source recognition test. Across three experiments, data were analyzed using a hierarchical Bayesian model of multidimensional source memory to determine how JOLs impact item memory as well as relatedness and color source memory. In Experiment 2, we also compared the effects of making JOLs to making judgments of relatedness (JORs), and Experiment 3 examined how JOLs impact study time allocation. The results of our experiments failed to fully follow predictions of either account. Making JOLs (Experiments 1-3) and JORs (Experiment 2) strengthened item memory for related as well as unrelated pairs, the latter finding not predicted by either account. In addition, JOLs and JORs did not specifically strengthen source memory for relatedness, as the cue-strengthening account predicts, nor did JOLs change study time (Experiment 3), as suggested by the changed-goal account. In all, our results provide novel insight that enhanced item memory may be largely responsible for JOL reactivity, thus adjudicating between candidate explanations. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Examining the influence of list composition on the mnemonic benefit of errorful generation

ABSTRACT Despite literature showing that errorful generation with corrective feedback enhances retention better than mere studying, it is unclear if this benefit depends on the composition of the learning list (pure error generation/read versus mixed). Here, we investigated whether the mnemonic advantage and metamnemonic evaluation of errorful generation generalise beyond mixed-list designs. Experiment 1 used a free-recall test, while Experiments 2 and 3 used a cued-recall test, with Experiment 3 also including a judgment of learning (JOL) assessment. Only when memory was tested via free recall did the benefit of errorful generation depend on experimental design, with the effect being most robust in mixed lists. Replicating past research, we too found that despite a clear mnemonic benefit for error generation in cued-recall tests, participants predicted better memory following read-only trials, and that this effect was not contingent on list composition. At the practical level, these findings demonstrate instances in which errorful generation is beneficial for memory and learning. At the theoretical level, the results fit nicely within the item-order framework in accounting for commonly observed design effects in free recall.

What guides the judgment of learning: Memory or heuristics? An event-related potential study

Memory monitoring ability is essential for the effectiveness of learning processes. Judgment of Learning (JOL), a metacognitive judgment, is commonly used to measure this ability. An ongoing debate questions whether JOL is an outcome of an inferential or recollective experience, as suggested by different hypotheses regarding the underlying cognitive mechanisms of this judgment. To address this question through a neuroscientific perspective, we aimed to investigate the temporal dynamic of JOL adopting event-related potential (ERP) methodology. Seventy-two young adults participated in an episodic memory task involving word-pairs as stimuli. Their JOLs were obtained through categorical choices in a delayed condition. Additionally, their memory performance was tested in the recognition phase. ERP components were compared for different JOL levels, as well as for the hit responses in the recognition test according to their JOL levels. The analyses showed that JOL processes are observable within an early time window after stimulus presentation, as evidenced by elicitation of the P100, N100, P200, N200, and P300 components across all JOL levels. However, only the amplitude of the N100 varied among these levels. A negative ERP component with 330–500 ms latency was also evident for all JOL levels in the central and parietal electrodes, which did not differ in amplitude. The analyses of the recognition phase ERPs showed that the hit responses did not exhibit a significant difference in the familiarity-related mid-frontal old/new effect (FN400) amplitude; however, those with high level of JOL elicited recollection-related parietal old-new effect with a smaller amplitude. These findings support both hypotheses suggesting that JOL is influenced by heuristics and the retrievability of information.

Age- and task-setting-related performance predictions in prospective memory: Can metacognition explain the age-prospective memory paradox?

This study explored the role of metacognition in the so-called “age-prospective memory (PM) paradox” by investigating the accuracy of younger and older adults’ predictions of their future PM performance in time-based tasks performed across laboratory and naturalistic settings. Metacognitive monitoring was assessed by asking participants to make judgments-of-learning (JOLs) on an item level for both the prospective (remembering that something has to be done) and retrospective (remembering what to do) components of PM. In terms of PM performance, the results for the prospective component revealed an age deficit in the laboratory-based task and an age benefit in the naturalistic task, in line with the age-PM paradox. In terms of metacognition, important age differences were found across settings. In particular, the results pointed to poor resolution of JOLs made by older adults in the laboratory and by younger adults in the naturalistic setting. This suggests that younger and older participants could not discriminate between items they would later hit or miss but did so in different settings. Furthermore, although both age groups exhibited overconfidence in the naturalistic setting, this bias was significantly stronger for the younger adults. This might explain the observed differences in performance. That is, the advantage older adults have in naturalistic tasks may stem from a better ability to predict performance in this setting compared to younger adults, who tend instead to heavily overestimate their capabilities and may therefore not engage in appropriate strategies or planning. These findings speak to the functional relevance of metacognitive monitoring processes for PM performance and suggest considering metacognition as a key factor in explaining the age-PM paradox.

Judgments of learning reactively affect memory by inducing covert retrieval

Making judgments of learning (JOLs) can directly influence memory, a phenomenon termed the reactivity effect of JOLs. However, controversy surrounds the mechanism behind JOL reactivity. This study employs related and unrelated word pairs as learning materials to compare memory outcomes across different JOL conditions. We contrasted the traditional JOL reactivity paradigm with a covert retrieval induction paradigm to explore whether JOLs impact memory through covert retrieval. In Experiment 1, data from 40 participants (18 females, 22 males) were analyzed, revealed distinct patterns between the two paradigms. When word pairs are presented entirely, the JOL group outperforms the no-JOL group in memorizing related pairs, aligning with traditional JOL reactivity. Conversely, when target words are omitted, the JOL group’s memory resembles that of the no-JOL group. This comparison suggested that JOLs may prompt covert retrieval. In Experiment 2, which involved manipulating the retrieval strength, data from 52 participants (46 females, 6 males) were analyzed, yielded results consistent with those of Experiment 1. We conclude that covert retrieval significantly contributes to the JOL reactivity effect, enhancing memory through JOL-induced covert retrieval.

Effects of personality traits and mood induction on metamemory judgments and metacognitive beliefs

Although the effects of mood and personality traits on memory performance have previously been studied, their relationship to the metamemory and metacognitive processes is still unknown. In this study, we investigated the effects of mood induction (positive and negative) and personality traits (extroverted and neurotics) on metacognitive beliefs, memory confidence, the judgment of learning (JOL) and feeling of knowing (FOK) judgments during face-name recognition tasks. One hundred twenty-seven participants who met the criteria based on their extraverted and neurotic personality scores on the Big Five Personality Inventory were randomly assigned to positive and negative mood induction conditions. We found that neurotics showed lower JOL judgments and accuracy than extroverts. The interaction effect between mood and personality significantly affected JOL and FOK accuracy, indicating that while extraverts were more accurate during positive induction, neurotics were more accurate during negative induction. In addition, neurotics were underconfident in their memory and reported more negative metacognitive beliefs than extroverts. We concluded that memory and metamemory processes are distinguishable in their relationships with mood states and personality traits. Our data also showed that JOL and FOK are distinct processes that support domain-specific metacognitive judgments.

The Self-Reference Effect in Metamemory and the Role of Beliefs in This Process.

Previous research has shown a clear self-reference effect in our memory. However, the question arises as to whether this effect could extend to higher cognitive domains such as metamemory. Thus, this study examined the effects of different encoding types on judgments of learning (JOLs) and explored the role of beliefs in this process. A one-way (encoding type: semantic, self-referential) within-participants design was employed in Experiment 1, which found no self-reference effect in JOLs. In Experiment 2, we manipulated participants' beliefs to explore their effect on JOLs under different encoding strategies. The results showed that learners' metamemory beliefs about encoding types influence JOLs. Learners who believed that self-referential and semantic encoding had the same memory effect tended to give equal JOLs to both words. However, learners who believed that self-referential encoding had a better memory effect than semantic encoding gave higher JOLs to self-referentially encoded words. The conclusions are as follows: There is no self-reference effect in JOLs, but learners' metamemory beliefs about encoding types influence JOLs.

The disconnect between metamemory and memory for emotional images

ABSTRACT Emotional information is reliably predicted to be remembered better than neutral information, and this has been found for words, images, and facial expressions. However, many studies find that these judgments of learning (JOLs) are not predictive of memory performance (e.g. [Hourihan, K. L. (2020). Misleading emotions: Judgments of learning overestimate recognition of negative and positive emotional images. Cognition and Emotion, 34(4), 771–782. https://doi.org/10.1080/02699931.2019.1682972]). The present study investigates and rules out numerous potential causes for this discrepancy between memory predictions and performance, including (1) reactivity to making JOLs, (2) idiosyncrasies of specific images used, (3), type of memory test, and (4) effects of fluency. Three additional experiments investigate whether JOLs can become more predictive of memory performance, either by experience with the task or by manipulating prior beliefs about memory for emotional images. In all experiments, we found the same effect: Emotional images are inaccurately predicted to be remembered better than neutral images. The results suggest that emotion is used as a heuristic for learning, resulting in low metamnemonic accuracy for emotional stimuli.

Age-related differences in metacognitive reactivity in younger and older adults

When we monitor our learning, often measured via judgments of learning (JOLs), this metacognitive process can change what is remembered. For example, prior work has demonstrated that making JOLs enhances memory for related, but not unrelated, word pairs in younger adults. In the current study, we examined potential age-related differences in metacognitive reactivity. Younger and older adults studied lists of related and unrelated word pairs to remember for a later cued recall test where they would be presented with one of the words from the pair and be asked to recall its associate. Additionally, participants either made a JOL for each pair or had an inter-stimulus interval of equal duration as the JOL period. Results revealed that while making metacognitive judgments did not significantly affect memory in younger adults (i.e., no reactivity), this procedure impaired memory in older adults (i.e., negative reactivity), particularly for unrelated word pairs. Specifically, older adults demonstrated better cued recall when each word was followed by an inter-stimulus interval than when asked to predict the likelihood of remembering each word during the study phase. This may be a consequence of JOLs increasing task demands/cognitive load, which could reduce the elaborative encoding of associations between word pairs in older adults, but older adults’ preserved or even enhanced semantic memory may mask negative reactivity for related word pairs. Future work is needed to better understand the mechanisms contributing to the reactivity effects in younger and older adults for different types of to-be-remembered information.

Judgments of Learning Reactively Improve Memory by Enhancing Learning Engagement and Inducing Elaborative Processing: Evidence from an EEG Study.

Making judgments of learning (JOLs) can reactively alter memory itself, a phenomenon termed the reactivity effect. The current study recorded electroencephalography (EEG) signals during the encoding phase of a word list learning task to explore the neurocognitive features associated with JOL reactivity. The behavioral results show that making JOLs reactively enhances recognition performance. The EEG results reveal that, compared with not making JOLs, making JOLs increases P200 and LPC amplitudes and decreases alpha and beta power. Additionally, the signals of event-related potentials (ERPs) and event-related desynchronizations (ERDs) partially mediate the reactivity effect. These findings support the enhanced learning engagement theory and the elaborative processing explanation to account for the JOL reactivity effect.

교수를 통한 학습(learning-by-teaching)이 메타인지적 판단에 미치는 영향

The present study investigated the effect of learning-by-teaching on learners' metacognitive judgments and examined how beneficial effects of teaching changed depending on whether or not retrieval practice was evoked during teaching. Undergraduate students studied science passages through two learning phases. In the first phase participants read the passage and in the second phase they either restudied them (control), created a video lecture with their notes (teaching without retrieval practice; TnRP), or taught without any materials (teaching with retrieval practice; TRP). Following each phase, they made metacognitive judgments regarding their comprehension of the passages, and then took a final test, which included retention and inference questions. The results showed that, despite the non-significant difference in the final test performance, there were significant differences in the judgments of learning (JOLs) across the three conditions. After the second learning phase, JOLs increased in the control group, remained unchanged in the TnRP group, and decreased in the TRP group, compared to their initial JOLs. As a result, the TRP group showed significantly lower levels of metacognitive bias and higher metacomprehension accuracy compared to the other groups. Our findings suggest that learning-by-teaching can mitigate overconfidence in learners and enhance metacomprehension accuracy, particularly when teaching is accompanied by retrieval practice.

Predicting the memorability of scene pictures: Improved accuracy through one's own experience.

There are conflicting findings regarding the accuracy of metamemory for scene pictures. Judgements of stimulus memorability in general (memorability judgements [MJs]) have been reported to be unpredictive of actual image memorability. However, other studies have found that judgements of learning (JOLs)-predictions of one's own later memory performance for recently studied items-are moderately predictive of people's own actual recognition memory for pictures. The current study directly compared the relative accuracy and cue basis of JOLs and MJs for scene pictures. In Experiments 1 and 2, participants completed an MJ task and a JOL task in counterbalanced order. In the MJ task, they judged the general memorability of each picture. In the JOL task, they studied pictures and made JOLs during a learning phase, followed by a recognition memory test. Results showed that MJs were predictive of general scene memorability and relied on the same cues as JOLs, but MJ accuracy considerably improved after the JOL task. Experiment 3 demonstrated that prior learning experiences drove this increase in MJ accuracy. This work demonstrates that people can predict not only their own future memory performance for scene pictures with moderate accuracy but also the general memorability of scene pictures. In addition, experiences with one's own learning and memory support the ability to assess scene memorability in general. This research contributes to our understanding of the basis and accuracy of different metamemory judgements.

I remember it now, so I'll remember it later: Working memory strength guides predictions for long-term memory performance.

Judgments of learning (JOLs) are assumed to be made inferentially, based on cues. This cue-utilization approach substituted the theory that memory strength guides JOLs. The rejection of this theory ignores the existence of two memory systems: working memory (WM), which holds representations immediately accessible, and long-term memory (LTM), which is a permanent store. By manipulating and measuring WM strength, we tested a revised version of the memory-strength theory in which JOLs are guided by WM representations. In Experiment 1, participants memorized sequences of two or four colored objects, then they provided JOLs for an LTM test of these objects, and performed a WM test on the objects' colors. After learning 200 objects, the LTM test followed. Sequence-length affected WM, but not LTM performance. JOLs, however, were higher for sequences of two than for four objects and correlated higher with WM than LTM performance. We replicated these results with a simultaneous presentation of the objects (Experiment 2), in the absence of a WM test (Experiment 3), and in a word-pair task (Experiment 4). Overall, our findings are consistent with the revised memory-strength theory. WM strength should therefore be considered when examining the factors guiding JOLs.

Probing the effect of perceptual (dis)fluency on metacognitive judgments.

Despite research showing that perceptually fluent stimuli (i.e., stimuli that are easier to process) are given higher judgment of learning (JOL) ratings than perceptually disfluent stimuli, it remains unknown whether the influence of perceptual fluency on JOLs is driven by the fluent or disfluent items. Moreover, it is unclear whether this difference hinges on relative differences in fluency. The current study addressed these unanswered questions by employing (Fiacconi et al., Journal of Experimental Psychology: Learning, Memory, and Cognition 46:926-944, 2020), Journal of Experimental Psychology: Learning, Memory, and Cognition, 46[5], 926-944) letter set priming procedure. In this procedure, participants are first exposed to words containing only a subset of letters. Following this exposure, JOLs to new words composed of the same letters (i.e., fluent), and new words composed of nonexposed letters (i.e., disfluent) are compared with isolate the contribution of perceptual fluency. Because this procedure does not rely on parametric variations in perceptual features, we can directly assess the potential benefit and/or cost of fluent and disfluent items, respectively, by including neutral baseline conditions. Moreover, implementing both a mixed- and pure-list design allowed us to assess the comparative nature of perceptual fluency on JOLs. Counter to previous assumptions, our results are the first to demonstrate that perceptual disfluency decreases JOLs. Moreover, we found that the influence of perceptual disfluency on JOLs hinges on the relative differences in fluency between items even in the absence of a belief about the mnemonic impact of the fluency manipulation. These findings have important implications as they provide evidence that the difficulty, rather than ease, of information form the basis of individuals metacognitive judgments.

Judgments of Learning Reactivity on Item-Specific and Relational Processing.

Judgments of learning (JOLs) reactivity refers to the finding that the mere solicitation of JOLs modifies subsequent memory performance. One theoretical explanation is the item-specific processing hypothesis, which posits that item-level JOLs redound to the benefit of later memory performance because they enhance item-specific processing. The current study was designed to test this account. We factorially manipulated the organization (blocked vs. randomized) of categorized lists and JOL condition (item-JOLs, list-JOLs, no-JOLs) between participants, and fit the dual-retrieval model to free recall data to pinpoint the underlying memory processes that were affected by JOL solicitation. Our results showed that item-level JOLs produced positive reactivity for randomized but not for blocked categorized lists. Moreover, we found that the positive JOL reactivity for randomized categorized lists was tied to a familiarity judgment process that is associated with gist processing, rather than to item-specific recollective processes. Thus, our results pose a challenge to the item-specific processing explanation of JOL reactivity. We argue that JOL reactivity is not restricted to item-specific processing; instead, whether JOLs predominantly engage participants with item-specific or relational processing depends on the interaction between learning stimuli and JOLs.

Face masks degrade our ability to remember face-name associations more than predicted by judgments of learning

ABSTRACT In response to the COVID-19 pandemic, face masks became required attire. Face masks obstruct the bottom portion of faces, restricting face processing. The present study examined the influence face masks have on memory predictions and memory performance for new face-name associations. Participants studied face-name pairs presented for 8 s (Experiment 1) or 10 s (Experiment 2). Half of the face-name pairs included a face mask obstructing the nose and mouth of the pictured face, counterbalanced across participants. Participants provided item-by-item judgements of learning (JOLs) and completed subsequent cued recall and associative recognition memory tests. Both experiments demonstrated that face masks impaired memory for newly-learned names, however, the magnitude of the mask impact was under-predicted by JOLs. The presence of a face mask negatively influenced memory performance to a greater degree than participants’ JOLs predicted. Results have implications for name learning during pandemics, as well as in settings where face masks are common (e.g., medical field).

Judgments of learning in bilinguals: Does studying in a L2 hinder learning monitoring?

Nowadays, use of a second language (L2) has taken a central role in daily activities. There are numerous contexts in which people have to process information, acquire new knowledge, or make decisions via a second language. For example, in academia and higher education, English is commonly used as the language of instruction and communication even though English might not be students' native or first language (L1) and they might not be proficient in it. Such students may face different challenges when studying and learning in L2 relative to contexts in which they study and learn in their L1, and this may affect their metamemory strategies. However, little is yet known about whether metamemory processes undergo significant changes when learning is carried out in L2. The aim of the present study was to investigate the possible consequences on learning derived from studying materials in L2 and, more specifically, to explore whether the interplay between monitoring and control (metamemory processes) changes as a function of the language involved. In three experiments, we explored whether font type (Experiment 1), concreteness (Experiment 2), and relatedness (Experiment 3) affected judgments of learning (JOLs) and memory performance in both L1 and L2. JOLs are considered the result of metacognitive strategies involved in the monitoring of learning and have been reported to vary with the difficulty of the material. The results of this study showed that people were able to monitor their learning in both L1 and L2, even though they judged L2 learning as more difficult than L1. Interestingly, self-perceived difficulty did not hinder learning, and people recognized L2 materials as well or better than L1 materials. We suggest that this might be an example of a desirable difficulty for memory.

Judgments of learning reflect the encoding of contexts, not items: evidence from a test of recognition exclusion

ABSTRACT Two sources of evidence seem to be shared by judgments of past recognition and judgments of future performance: item memory or familiarity (i.e., memory for the item independent of the context in which it was experienced) and context memory or recollection (i.e., memory for the context specific to a particular prior encounter). However, there are few studies investigating the link between these two putative memory processes and judgments of learning (JOLs). We tested memory and metamemory using a continuous exclusion procedure – a modified recognition memory task where study events for two classes of items are interleaved with test trials in which the subject must endorse items from one class and reject items from the other. This procedure allowed us to estimate the influences of memory for context and memory for item on JOLs and licenses conclusions about the relative role of item and context information in supporting JOLs. An analysis of forgetting revealed that JOLs reflect both the initial degree of learning and the rate of forgetting, but only of memory for context and not of memory for items. These findings suggest that JOLs are predictive of memory for context-bound episodes, rather than for the semantic content of those episodes.

Item-specific and relational encoding are effective at reducing the illusion of competence.

Metamemory, or the ability to understand the capacities of one's own memory, is important for learning. To investigate questions surrounding metamemory, researchers commonly have participants make judgments of learning (JOLs) at encoding, in which participants rate their likelihood of recalling the target in a cue-target word pair when shown only the cue at test. However, the associative direction of cue-target pairs can affect the calibration of JOLs. Unlike forward associates (e.g., credit-card), in which JOLs often accurately predict recall, an illusion of competence has been reported for backward associates (e.g., card-credit), symmetrical associates (e.g., salt-pepper), and unrelated cue-target pairs (e.g., artery-bronze) such that JOLs overestimate later recall. The present study evaluates whether the illusion of competence can be reduced when participants apply deep item-specific or relational encoding tasks relative to silent reading. Across two experiments, we show that both item-specific and relational encoding strategies reduce the illusion of competence for backward associates and unrelated pairs while improving the calibration between JOLs and recall. Our findings suggest that these encoding strategies are effective at reducing the illusion of competence, with increased calibration primarily reflecting improved recall. Thus, item-specific and relational encoding strategies primarily affect retrieval processes rather than metacognitive processes that participants engage in at encoding.