Video Deficit Research Articles

Revisiting the video deficit in technology-saturated environments: Successful imitation from people, screens, and social robots

The “video deficit” is a well-documented effect whereby children learn less well about information delivered via a screen than the same information delivered in person. Research suggests that increasing social contingency may ameliorate this video deficit. The current study instantiated social contingency to screen-based information by embodying the screen within a socially interactive robot presented to urban Australian children with frequent exposure to screen-based communication. We failed to document differences between 22- to 26-month-old children’s (N = 80) imitation of screen-based information embedded in a social robot and in-person humans. Furthermore, we did not replicate the video deficit with children imitating at similar levels regardless of the presentation medium. This failure to replicate supports the findings of a recent meta-analysis of video deficit research whereby there appears to be a steady decrease over time in the magnitude of the video deficit effect. We postulate that, should the video deficit effect be truly dwindling in effect size, the video deficit may soon be a historical artifact as children begin perceiving technology as relevant and meaningful in everyday life more and more. This research finds that observational-based learning material can be successfully delivered in person, via a screen, or via a screen embedded in a social robot.

Searching in the sand: Protracted video deficit in U.S. preschoolers' spatial recall using a continuous search space.

Young children exhibit a video deficit for spatial recall, learning less from on-screen than in-person demonstrations. Some theoretical accounts emphasize memory constraints (e.g., insufficient retrieval cues, competition between memory representations). Such accounts imply memory representations are graded, yet video deficit studies measuring spatial recall operationalize memory retrieval as dichotomous (success or failure). The current study tested a graded-representation account using a spatial recall task with a continuous search space (i.e., sandbox) rather than discrete locations. With this more sensitive task, a protracted video deficit for spatial recall was found in children 4-5years old (n=51). This may be due to weaker memory representations in the screen condition, evidenced by higher variability and greater perseverative bias. In general, perseverative bias decreased with repeated trials. The discussion considers how the results support a graded-representation account, potentially explaining why children might exhibit a video deficit in some tasks but not others. RESEARCH HIGHLIGHTS: The task used a continuous search space (sandbox), making it more difficult and sensitive than spatial recall tasks used in prior video deficit research. Spatial recall among 4- and 5-year-old children was more variable after watching hiding events on screen via live video feed than through a window. Children's spatial recall from screens was more susceptible to proactive interference, evidenced by more perseverative bias in an A-not-B design. The results demonstrate memory representations blend experiences that accumulate over time and explain why the video deficit may be protracted for more difficult tasks.

Can infants use video to update mental representations of absent objects?

Before their second birthday, infants can update their knowledge based on what someone tells them, but can they do so based on what a video shows them? The current study explored whether infants can update their representation of an absent object’s properties after seeing a video of something happening to it, following seminal work showing that they can update their representation after being told about something happening to it (Ganea et al., 2007). It thus adapted an existing paradigm for testing infants’ understanding of references to absent objects (using language) to investigate a different symbolic medium (video). Twenty-two-month-olds first played with a toy and later saw on video that the toy underwent a change in state while they were out of the room. Infants in the current study did not subsequently identify the toy based on this new information, whereas those in previous research did. Infants this age thus appear less likely to update their representation of an absent object’s properties using video than using language. This result is consistent with the possibility that infants may understand the representational function of symbolic objects later in development than they understand the representational function of language. It also aligns with evidence of the video deficit in which infants learn less effectively from video than from firsthand experience.

The early ontogeny of infants’ imitation of on screen humans and robots

Traditionally, infants have learned how to interact with objects in their environment through direct observations of adults and peers. In recent decades these models have been available over different media, and this has introduced non-human agents to infants’ learning environments. Humanoid robots are increasingly portrayed as social agents in on screen, but the degree to which infants are capable of observational learning from screen-based robots is unknown. The current study thus investigated how well 1- to 3-year-olds (N = 230) could imitate on-screen robots relative to on-screen and live humans. Participants exhibited an imitation deficit for robots that varied with age. Furthermore, the well-known video deficit did not replicate as expected, and was weak and transient relative to past research. Together, the findings documented here suggest that infants are learning from media in ways that differ from past generations, but that this new learning is nuanced when novel technologies are involved.

Word learning from a tablet app: Toddlers perform better in a passive context.

In recent years, the popularity of tablets has skyrocketed and there has been an explosive growth in apps designed for children. Howhever, many of these apps are released without tests for their effectiveness. This is worrying given that the factors influencing children's learning from touchscreen devices need to be examined in detail. In particular, it has been suggested that children learn less from passive video viewing relative to equivalent live interaction, which would have implications for learning from such digital tools. However, this so-called video deficit may be reduced by allowing children greater influence over their learning environment. Across two touchscreen-based experiments, we examined whether 2- to 4-year-olds benefit from actively choosing what to learn more about in a digital word learning task. We designed a tablet study in which "active" participants were allowed to choose which objects they were taught the label of, while yoked "passive" participants were presented with the objects chosen by their active peers. We then examined recognition of the learned associations across different tasks. In Experiment 1, children in the passive condition outperformed those in the active condition (n = 130). While Experiment 2 replicated these findings in a new group of Malay-speaking children (n = 32), there were no differences in children's learning or recognition of the novel word-object associations using a more implicit looking time measure. These results suggest that there may be performance costs associated with active tasks designed as in the current study, and at the very least, there may not always be systematic benefits associated with active learning in touchscreen-based word learning tasks. The current studies add to the evidence that educational apps need to be evaluated before release: While children might benefit from interactive apps under certain conditions, task design and requirements need to consider factors that may detract from successful performance.

Learning From Video: A Meta-Analysis of the Video Deficit in Children Ages 0 to 6Years.

Young children often learn less from video than face-to-face presentations. Meta-regression models were used to examine the average size of this difference (video deficit) and investigate moderators. An average deficit of about half of a standard deviation was reported across 122 independent effect sizes from 59 reports, involving children ages 0-6years. Moderator analyses suggested (a) the deficit decreased with age, (b) object retrieval studies showed larger deficits than other domains, and (c) there was no difference between studies using live versus prerecorded video. Results are consistent with a multiple-mechanism explanation for the deficit. However, the analyses highlighted potential quality and publication bias issues that may have resulted in overestimation of the effect and should be addressed by future researchers.

I'm Doing Better on My Own: Social Inhibition in Vocabulary Learning in Adults.

Vocabulary learning is better achieved by children facing a teacher than when presented to the same teacher through video (so-called “video deficit” effect), which has significant implications for toddlers’ education. Since millions of adults also learn new vocabulary when acquiring a second language (L2), it is important to explore whether adults suffer from “video deficit” effects, as children do. In the present study, we report two experiments in which Spanish native late learners of English were involved in a vocabulary learning task. In Experiment 1, participants had to learn English (L2) labels associated to real objects. In Experiment 2, participants had to learn English (L2) and Spanish (L1) labels associated to novel objects. In both experiments, vocabulary learning was divided into three conditions: In the NoFace condition, participants were presented with the objects and their auditory labels, through video. In the Video condition, a teacher was showing the objects and uttering their names, through video. The Live condition was equivalent, except that the teacher was facing the participants in the room. Each condition was followed by a recall test. Better learning in Video compared to NoFace condition revealed that adults benefit from the teacher’s display with direct gaze, confirming the fundamental role of face display with direct gaze in social communication in adults. Interestingly, adults learned better through Video than in the Live condition. Those results were obtained in L2 vocabulary learning in both Experiments 1 and 2, and also generalized to native language in Experiment 2. We argue that adults suffer from social inhibition, meaning that they perform worse when in the presence of another person during task performance. In sum, we show that video-mediated teaching might not be detrimental for adults learning new vocabulary lists, as it is the case for young children. These results might have important implications for pedagogical programs targeting adults’ second language vocabulary learning, since proper acquisition of vocabulary list can be achieved through video including a teacher’s display.

Theory of Mind and the Video Deficit Effect: Video Presentation Impairs Children’s Encoding and Understanding of False Belief

ABSTRACTThe video deficit effect (VDE) has been demonstrated in several studies on word learning, self-recognition, and imitation: Younger children (up to 3 years old) solved tasks more easily in a direct interaction with an examiner than when instructed by video (Anderson & Pempek, 2005). Older children might also be susceptible to a VDE, especially with more complex tasks; however, evidence is sparse. Furthermore, to what extent preschoolers’ understanding of others’ mental states (theory of mind) is impaired by video presentations has not been tested. We tested 174 children of 4 and 5 years of age in a traditional change of location task for false belief understanding (cf. Baron-Cohen, Leslie, & Frith, 1985). Children were presented with the original story, enacted by adult actors, in either a video or a live demonstration. Children watched the events in 2 live conditions, either through a 1-way mirror or directly. Our results indicate a significant VDE for 4- and 5-year-old children regarding the encoding and solution of the false belief task, respectively.

Observational learning in capuchin monkeys: a video deficit effect.

Young human children have been shown to learn less effectively from video or televised images than from real-life demonstrations. Although nonhuman primates respond to and can learn from video images, there is a lack of direct comparisons of task acquisition from video and live demonstrations. To address this gap in knowledge, we presented capuchin monkeys with video clips of a human demonstrator explicitly hiding food under one of two containers. The clips were presented at normal, faster than normal, or slower than normal speed, and then the monkeys were allowed to choose between the real containers. Even after 55 sessions and hundreds of video demonstration trials the monkeys' performances indicated no mastery of the task, and there was no effect of video speed. When given live demonstrations of the hiding act, the monkeys' performances were vastly improved. Upon subsequent return to video demonstrations, performances declined to pre-live-demonstration levels, but this time with evidence for an advantage of fast video demonstrations. Demonstration action speed may be one aspect of images that influence nonhuman primates' ability to learn from video images, an ability that in monkeys, as in young children, appears limited compared to learning from live models.

Baby FaceTime: can toddlers learn from online video chat?

There is abundant evidence for the 'video deficit': children under 2years old learn better in person than from video. We evaluated whether these findings applied to video chat by testing whether children aged 12-25months could form relationships with and learn from on-screen partners. We manipulated social contingency: children experienced either real-time FaceTime conversations or pre-recorded Videos as the partner taught novel words, actions and patterns. Children were attentive and responsive in both conditions, but only children in the FaceTime group responded to the partner in a temporally synced manner. After one week, children in the FaceTime condition (but not the Video condition) preferred and recognized their Partner, learned more novel patterns, and the oldest children learned more novel words. Results extend previous studies to demonstrate that children under 2years show social and cognitive learning from video chat because it retains social contingency. A video abstract of this article can be viewed at: https://youtu.be/rTXaAYd5adA.

Video Deficit in Toddlers’ Object Retrieval: What Eye Movements Reveal About Online Cognition

The purpose of this study was to determine whether toddlers exhibit different eye‐movement patterns when watching real events versus video demonstrations in an object‐retrieval task. Twenty‐four‐month‐olds (N = 36) searched for a sticker on a felt board after watching an experimenter hide it behind a felt object in person or via video. Eye movements during the hiding event were recorded. Compared to those watching in‐person events, children watching video spent more time looking at the target location overall, yet they had relatively poor search performance. Visual attention to the target location predicted search performance in the video condition only; children who watched in‐person hiding events had high success rates even if they paid relatively little visual attention to the correct location. Findings are consistent with the hypothesis that toddlers process information more quickly for in‐person (versus video) events, enabling them to learn as well (or better) despite relatively low selective attention. Thus, relatively poor encoding, as well as memory retrieval, may underlie the video deficit.

Children’s Use of Self-Paced Slideshows: An Extension of the Video Deficit Effect?

Past research has established that children typically learn better from live demonstrations than from two-dimensional (2D) media. In the present set of experiments, we investigated the efficacy of a new 2D learning medium—the self-paced slideshow. A primary goal was to determine whether the “video deficit effect” extended to self-paced slideshows. In Experiment 1, preschool-age children saw demonstrations of novel events either live, on video, or by advancing through self-paced slideshows. They were then tested on their performance and verbal memory. In line with past work, children in the live condition outperformed those in the video and slideshow conditions at reproducing the target actions. To further explore the 2D media, Experiment 2 directly compared learning from self-paced slideshows to that from videos. Changes to the stimuli included a more natural extraction rate of slides and a higher focus on the objects. Children’s performance differed little between conditions, with the exception of reproducing fewer actions in the slideshow than video condition on two (of four) toys. Ultimately, we conclude that the video deficit extends to self-paced slideshows. Future work must investigate how to enhance children’s learning from 2D sources, given their increasing role in daily life.

Age‐related changes in learning across early childhood: A new imitation task

Imitation plays a critical role in social and cognitive development, but the social learning mechanisms contributing to the development of imitation are not well understood. We developed a new imitation task designed to examine social learning mechanisms across the early childhood period. The new task involves assembly of abstract-shaped puzzle pieces in an arbitrary sequence on a magnet board. Additionally, we introduce a new scoring system that extends traditional goal-directed imitation scoring to include measures of both children's success at copying gestures (sliding the puzzle pieces) and goals (connecting the puzzle pieces). In Experiment 1, we demonstrated an age-invariant baseline from 1.5 to 3.5 years of age, accompanied by age-related changes in success at copying goals and gestures from a live demonstrator. In Experiment 2, we applied our new task to learning following a video demonstration. Imitation performance in the video demonstration group lagged behind that of the live demonstration group, showing a protracted video deficit effect. Across both experiments, children were more likely to copy gestures at earlier ages, suggesting mimicry, and only later copy both goals and gestures, suggesting imitation. Taken together, the findings suggest that different social learning strategies may predominate in imitation learning dependent upon the degree of object affordance, task novelty, and task complexity.

Special issue on the content and context of early media exposure

Exposing infants to screen media is a hotly debated topic. Part of the debate stems from perceived inconsistencies in the accumulated evidence. Correlational research has provided a number of associations between exposure and outcomes (both positive and negative; for review see Courage & Howe, 2010). Experimental evidence shows that when learning conditions are equated infants learn less from video than from live face-to-face interactions (i.e. video deficit, Anderson & Pempek, 2005). As the research literature has accumulated, however, it has shifted from simple main effects models to more complex interaction models of analysis. This complexity is captured through the analysis of three distinct but inter-connected classes of variables that mediate and moderate the relationship between exposure and child outcomes: child attributes, stimulus features, and the contexts in which exposure occur (see Linebarger & Vaala, 2010). There are two main purposes of this special issue: (1) empirically demonstrate the shift away from research that examines simplistic cause and effect models to research that examines the causal mechanisms underlying how effects are produced (Clark, 1983; Dupre & Cartwright, 1988; Hedstrom & Ylikoski, 2010; Kozma, 1994) and (2) focus on an ecological perspective and, as such, simultaneously consider the effects of content and context of early media exposure. Cause and effect models presume that learning is a receptive response to content delivery whereas models that incorporate causal mechanism-based explanations view learning as an active cognitive process influenced by the social, affective, and contextual variables present during a specific learning event (Clark, 1983). Defining causal mechanisms involves articulating the intersection among the child, the environmental context, and the ways in which both influence how a child ultimately interprets and learns from program content. An ecological perspective provides a way to conceptualize these processes as ‘substantive and theoretical[ly] significant’ (p. 626, Bronfenbrenner, 1995). It is these transactions that drive development and these transactions that are both affected by characteristics of the child and of the context in which these transactions occur.

Assessing the Research on Media, Cognitive Development, and Infants

With the rise of television targeting very young children, it is important to ask if babies younger than two can learn from it. In this essay I review the literature on babies' attention to, imitation of, and language learning from television and I discuss the research that has found a video deficit in young children. The literature suggests that infants between the ages of approximately twelve and twenty-four months have a difficult time imitating and learning from television. This deficit may occur because television is perceived by babies as socially irrelevant; it may also occur because television is not as rich in detail as live images. Lastly, it may occur because of the complexity of dual representation. The extant literature also suggests that basic conceptual knowledge is needed in infants before more advanced learning, such as language acquisition, can be achieved. The essay explores whether television is capable of teaching these very basic cognitive skills.

Self‐recognition in live videos by young children: does video training help?

The overall aim of the experiment reported here was to establish whether self‐recognition in live video can be facilitated when live video training is provided to children aged 2–2.5 years. While the majority of children failed the test of live self‐recognition prior to video training, more than half exhibited live self‐recognition post video training. Children who failed the live video self‐recognition tasks passed the test of mirror self‐recognition. The findings are discussed in light of a video deficit and the potential role of pre‐test training in facilitating self‐recognition in live video by young children.

Can Social Meaningfulness and Repeat Exposure Help Infants and Toddlers Overcome the Video Deficit?

Two experiments were conducted to test several questions regarding very young children's (6–24 months) learning (i.e., simple action imitation and word learning) from video. Specifically, this study tested the video deficit, which is the tendency for infants and toddlers to learn significantly more effectively from live information than they do when identical information is presented on a screen. First, the video deficit was explored using two different tasks. Overall, the pattern of results was similar for action imitation and word learning. Specifically, the video deficit was present for both simple action imitation and for word learning in the middle cohort, but not present for younger and older children. Second, there was some mitigation of the video deficit from seeing socially meaningful actors for action imitation; however for word learning the effect only approached significance. Third, repetition helped children learn words more effectively, especially for the youngest and oldest cohort; however, repetition did not help for simple task imitation.

Infant imitation from television using novel touch screen technology

Infants learn less from a televised demonstration than from a live demonstration, the video deficit effect. The present study employs a novel approach, using touch screen technology to examine 15-month olds' transfer of learning. Infants were randomly assigned either to within-dimension (2D/2D or 3D/3D) or cross-dimension (3D/2D or 2D/3D) conditions. For the within-dimension conditions, an experimenter demonstrated an action by pushing avirtual button on a 2D screen or a real button on a 3D object. Infants were then given the opportunity to imitate using the same screen or object. For the 3D/2D condition, an experimenter demonstrated the action on the 3D object, and infants were given the opportunity to reproduce the action on a 2D touch screen (and vice versa for the 2D/3D condition). Infants produced significantly fewer target actions in the cross-dimension conditions than in the within-dimension conditions. These findings have important implications for infants' understanding and learning from 2D images and for their using 2D media as the basis of actions in the real world.

The effect of social engagement on 24‐month‐olds’ imitation from live and televised models

To date, developmental research has rarely addressed the notion that imitation serves an interpersonal, socially based function. The present research thus examined the role of social engagement on 24-month-olds' imitation by manipulating the social availability of the model. In Experiment 1, the children were more likely to imitate the exact actions of a live socially responsive model compared to a videotaped model who could not provide socially contingent feedback. In Experiment 2, the children were more likely to imitate the exact actions of a model with whom they could communicate via a closed-circuit TV system than a videotaped model who could not provide interactive feedback. This research provides clear evidence that children's imitative behavior is affected by the social nature of the model. These findings are discussed in relation to theories on imitation and the video deficit.

“Don’t try this at home”: Toddlers’ imitation of new skills from people on video

Imitation of people on educational television is a potential way for very young children to learn new skills. Although toddlers in previous studies exhibited a “video deficit” in learning, 24-month-olds in Study 1 successfully reproduced behaviors modeled by a person who was on video as well as they did those modeled by a person who was present in the room (even after a 24-h delay). Neither displaced filming context nor cuts between actions affected toddlers’ imitation from video. Shortening the demonstration in Study 2 affected imitation in the video condition but not in the live condition. In Study 3, 24-month-olds who viewed the original longer videos on their family TV screens (with which they had a viewing history) imitated significantly less than those who viewed the videos on the laboratory monitor. Imitation of a live modeler was the same across settings (home or lab). Implications for toddlers’ judgments of reliable information sources and for the design of educational television programs are discussed.