Preparation For Future Learning Research Articles

Identifying Perspectives on Physical Therapist Residency Program Goals: Hallmarks of Success and Excellence.

The purpose of this study was to describe common perspectives important to achieving excellence and success in physical therapist residency education programs. Individuals with direct responsibility for creating and revising physical therapist residency program goals participated in a mixed-methods study using Q-methodology. They sorted 31 goal topics based on the level of importance for achieving excellence and success in physical therapist residency education. By-participant factor analysis identified dominant perspectives, which were interpreted based on emergent themes from the topics identified as the most important. Participants' rationale for selecting goal topics as the most important were extracted from the post-survey. Seventy-three individuals responded, representing 9 of the 11 clinical residency areas of practice. Three main perspectives emerged: resident behaviors, resident achievements, and program attributes. One shared perspective emerged across all 3 factors that emphasized the residents' ability to become self-regulated, lifelong learners who integrate learning into practice: preparation for future learning. Variability in weighting the importance of program goals associated with each perspective may include a program's organization and mission, individual beliefs and experiences related to program leadership, and resource availability. Although respondent emphasis placed importance of some items over others, the findings do not suggest that items ranked lower were unnecessary or unimportant in achieving program excellence. The relative importance of items was weighted differently based on the perspective of program leadership and the individual completing the sorting activity. The results of this study suggest that physical therapist residency programs should have at least 1 or 2 goals in each of the 3 distinct perspectives, as well as the 1 shared perspective identified in our findings. Some consistency in program goals based on the perspectives identified here may enable further research exploring excellence, value, and outcomes in physical therapist residency education.

Conceptualizing U.S. educational television as preparation for future learning

ABSTRACT Children sometimes fail to transfer lessons gleaned from educational television. However, exposure to this content might impart foundational knowledge that facilitates children’s learning from subsequent formal instruction. This possibility is consistent with the predictions of a theoretical framework known as “preparation for future learning” (PFL). In the current experiment, 4- to 6-year-old children (N = 109) watched one of three educational science programs about buoyancy or a control program about magnification. Afterward, all children observed a live demonstration about buoyancy and participated in two assessments of learning (i.e. once after television exposure and again after the live demonstration). Children who watched the buoyancy programs performed better across more assessments than children who watched the control program. Unexpectedly, more consistent benefits emerged among children who watched animated (vs. live action) programs. These findings provided mixed support for the PFL framework, and recommendations for future research are provided.

On embedding assessments of self-regulated learning into licensure activities in the health professions: a call to action.

How well have healthcare professionals and trainees been prepared for the inevitable demands for new learning that will arise in their future? Given the rapidity with which ‘core healthcare knowledge’ changes, medical educators have a responsibility to audit whether trainees have developed the capacity to effectively self-regulate their learning. Trainees who engage in effective self-regulated learning (SRL) skillfully monitor and control their cognition, motivation, behaviour, and environment to adaptively meet demands for new learning. However, medical curricula rarely assess trainees’ capacity to engage in these strategic processes. In this position paper, we argue for a paradigm shift toward assessing SRL more deliberately in undergraduate and postgraduate programs, as well as in associated licensing activities. Specifically, we explore evidence supporting an innovative blend of principles from the science on SRL, and on preparation for future learning (PFL) assessments. We propose recommendations for how program designers, curriculum developers, and assessment leads in undergraduate and postgraduate training programs, and in licensing bodies can work together to develop integrated assessments that measure how and how well trainees engage in SRL. Claims about lifelong learning in health professions education have gone unmatched by responsive curricular changes for far too long. Further neglecting these important competencies represents a disservice to medical trainees and a potential risk to the future patients they will care for.

How supervision and educational supports impact medical students\u2019 preparation for future learning of endotracheal intubation skills: a non-inferiority experimental trial

BackgroundProfessional education cannot keep pace with the rapid advancements of knowledge in today’s society. But it can develop professionals who can. ‘Preparation for future learning’ (PFL) has been conceptualized as a form of transfer whereby learners use their previous knowledge to learn about and adaptively solve new problems. Improved PFL outcomes have been linked to instructional approaches targeting learning mechanisms similar to those associated with successful self-regulated learning (SRL). We expected training that includes evidence-based SRL-supports would be non-inferior to training with direct supervision using the outcomes of a ‘near transfer’ test, and a PFL assessment of simulated endotracheal intubation skills.MethodThis study took place at the University of Toronto from October 2014 to August 2015. We randomized medical students and residents (n = 54) into three groups: Unsupervised, Supported; Supervised, Supported; and Unsupervised, Unsupported. Two raters scored participants’ test performances using a Global Rating Scale with strong validity evidence. We analyzed participants’ near transfer and PFL outcomes using two separate mixed effects ANCOVAs.ResultsFor the Unsupervised, Supported group versus the Supervised, Supported group, we found that the difference in mean scores was 0.20, with a 95% Confidence Interval (CI) of − 0.17 to 0.57, on the near transfer test, and was 0.09, with a 95% CI of − 0.28 to 0.46, on the PFL assessment. Neither mean score nor their 95% CIs exceeded the non-inferiority margin of 0.60 units. Compared to the two Supported groups, the Unsupervised, Unsupported group was non-inferior on the near transfer test (differences in mean scores were 0.02 and − 0.22). On the PFL assessment, however, the differences in mean scores were 0.38 and 0.29, and both 95% CIs crossed the non-inferiority margin.ConclusionsTraining with SRL-supports was non-inferior to training with a supervisor. Both interventions appeared to impact PFL assessment outcomes positively, yet inconclusively when compared to the Unsupervised and Unsupported group, By contrast, the Unsupervised, Supported group did not score well on the near transfer test. Based on the observed sensitivity of the PFL assessment, we recommend researchers continue to study how such assessments may measure learners’ SRL outcomes during structured learning experiences.

Exploring why we learn from productive failure: insights from the cognitive and learning sciences.

Advances in Health Sciences Education (AHSE) has been at the forefront of the cognitive wave in health professions education for the past 25years. One example is research on productive failure, a teaching strategy that asks learners to attempt to generate solutions to difficult problems before receiving instruction. This study compared the effectiveness of productive failure with indirect failure to further characterize the underpinning cognitive mechanisms of productive failure. Year one pharmacy students (N = 42) were randomly assigned to a productive failure or an indirect failure learning condition. The problem of estimating renal function based on serum creatinine was described to participants in the productive failure learning condition, who were then asked to generate a solution. Participants in the indirect failure condition learned about the same problem and were given incorrect solutions that other students had created, as well as the Cockcroft-Gault formula, and asked to compare and contrast the equations. Immediately thereafter all participants completed a series of tests designed to assess acquisition, application, and preparation for future learning (PFL). The tests were repeated after a 1-week delay. Participants in the productive failure condition outperformed those in the indirect failure condition, both on the immediate PFL assessment, and after a 1-week delay. These results emphasize the crucial role of generation in learning. When preparing novice students to learn new knowledge in the future, generating solutions to problems prior to instruction may be more effective than simply learning about someone else's mistakes. Struggle and failure are most productive when experienced personally by a learner because it requires the learner to engage in generation, which deepens conceptual understanding.

Rutgers Robert Wood Johnson Medical School.

Rutgers Robert Wood Johnson Medical School.

Validation Reconceived: The Double Treatment Experimental Design

Learning is a process that leads to outcomes. The science of learning is the epistemic practice of investigating the relationship between this process and its outcomes. We propose a novel method for the study of learning: The Double Treatment experimental design. The core design for experimental studies in the Learning Sciences consists of two elements, learning activities together with assessments of their outcomes. In conventional Single Treatment experimental designs, the learning activities are subject to a controlled experimental manipulation, the outcomes of which are then evaluated in a common assessment. In the Double Treatment experimental design, both the learning activity and the assessment are subject to the experimental manipulation, leading to a basic 2 x 2 experimental design. We provide a theoretical rationale in favor of the Double Treatment design, which we illustrate and discuss in three experimental study examples implementing this method: A study on the contextual nature of memorization and recall while scuba diving, a study on invention activities as a preparation for future learning, and a study on resource-rich assessment in computer science. We argue that the Double Treatment design has the potential to enhance the epistemic power of experimental Learning Sciences research by improving the ontological coherence of experimental designs. They promise to facilitate both hypothesis testing and hypothesis generation, enable the validation of assessment methods from within corresponding studies, and reduce the need for externally validated assessments outside the control of the researchers.

Types of instructional strategies and their effect on Preparation for Future Learning in differentiation

This study investigated the relationship between instruction conditions and performance on direct application and transfer problems using Calculus 1 content. Eighty-one participants were assigned to either the ICalCulus (ICalC) group or Tell & Practice (TP) group. Results from Bayesian one-way ANCOVAs indicate that participants in the ICalC group outperformed the TP group on further Preparation for Future Learning (PFL) tasks from the delayed post-test in the second session. Bayesian repeated measures ANCOVAs showed cross-over interaction effects between time and the group condition for both PFL and further PFL, which indicates the stronger retention effect of the ICalC strategy. The findings of this study suggest directions for potential future studies to design more effective instructional strategies to facilitate PFL.

C2STEM: a System for Synergistic Learning of Physics and Computational Thinking

Synergistic learning combining computational thinking (CT) and STEM has proven to be an effective method for advancing learning and understanding in a number of STEM domains and simultaneously helping students develop important CT concepts and practices. We adopt a design-based approach to develop, evaluate, and refine our Collaborative, Computational STEM (C2STEM) learning environment. The system adopts a novel paradigm that combines visual model building with a domain-specific modeling language (DSML) to scaffold learning of high school physics using a computational modeling approach. In this paper, we discuss the design principles that guided the development of our open-ended learning environment (OELE) using a learning-by-modeling and evidence-centered approach for curriculum and assessment design. Students learn by building models that describe the motion of objects, and their learning is supported by scaffolded tasks and embedded formative assessments that introduce them to physics and CT concepts. We have also developed preparation for future learning (PFL) assessments to study students’ abilities to generalize and apply CT and science concepts and practices across problem solving tasks and domains. We use mixed quantitative and qualitative analysis methods to analyze student learning during a semester-long study run in a high school physics classroom. We document some of the lessons learned from this study and discuss directions for future work.

Tangible User Interfaces and Contrasting Cases as a Preparation for Future Learning

In this paper, we describe an experiment that compared the use of a Tangible User Interface (physical objects augmented with digital information) and a set of Contrasting Cases as a preparation for future learning. We carried out an experiment (N = 40) with a 2 × 2 design: the first factor compared traditional instruction (“Tell & Practice”) with a constructivist activity designed using the Preparation for Future Learning framework (PFL). The second factor contrasted state-of-the-art PFL learning activity (i.e., students studying Contrasting Cases) with an interactive tabletop featuring digitally enhanced manipulatives. In agreement with prior work, we found that dyads of students who followed the PFL activity achieved significantly higher learning gains compared to their peers who followed a traditional “Tell & Practice” instruction (large effect size). A similar effect was found in favor of the interactive tabletop compared to the Contrasting Cases (small-to-moderate effect size). We discuss implications for designing socio-constructivist activities using new computer interfaces.

Amultiple-perspective approach for the assessment and learning of ultrasound skills.

Ultrasound has become a core skill in many specialties. We evaluated the learning and assessment of ultrasound skills in Obstetrics-Gynaecology in a series of eight studies. In the clinical setting, we found that trainees as well as experienced clinicians struggle with technical aspects of performance such as image optimization. We examined how to improve these aspects of performance in the simulated setting by determining mastery learning levels and exploring learning curves for novices. We then examined how to improve the efficiency of training as well as transfer of learning through the use of dyad practice as compared with single practice. We found that the use of simulation-based training focusing on technical aspects of performance in addition to clinical training led to sustained improvements in performance after two months of clinical training in all aspects of performance. In addition, we found an interaction effect between initial simulation-based training and subsequent clinical training on trainees’ need for supervision. These findings suggest that simulation-based training can work as preparation for future learning rather than merely as added learning. Finally, we found that the use of simulation-based initial training led to a large decrease in patients’ discomfort, improvements in their perceived safety and confidence in their ultrasound operator. However, simulation-based training comes at a cost and in the final study we developed a model for conducting cost-effectiveness studies and provided data from an example study on how to link training costs with quality of care.

Sport-specific and non-specific practice of strong and weak responders in junior and senior elite athletics – A matched-pairs analysis

ABSTRACTElite track and field athletes with greater and lesser multi-year performance improvement were compared regarding their developmental sport-specific and non-specific, organised (coach-led) and non-organised (peer-led) sporting activities. Athlete pairs were matched on gender, discipline and baseline performance in competitions (at 13/19 years). Their unequal subsequent performance development during junior (13–17 years; n = 138) and senior (19–23+ years; n = 80) age ranges defined “strong responders” and “weak responders”. Analyses revealed that junior-age strong responders accumulated more organised practice in athletics than weak responders, while the amounts of all other types of activities were indifferent. Senior-age strong responders did not accumulate a greater total sum of all kinds of sport activities or greater amounts of organised practice in athletics or non-organised involvement in athletics or other sports than weak responders. But they engaged in more organised practice and competitions in other sports over more years (9 vs. 2 years) and specialised in athletics at a later age than weak responders (16 vs. 11 years). The results were also robust among senior international medallists vs. national medallists. The findings are reflected relative to the hypotheses of “multiple sampling and functional matching”, “learning transfer as preparation for future learning” and “authenticity of variable learning experiences”.

Preparation for future learning: a missing competency in health professions education?

Evidence suggests that clinicians may not be learning effectively from all facets of their practice, potentially because their training has not fully prepared them to do so. To address this gap, we argue that there is a need to identify systems of instruction and assessment that enhance clinicians' 'preparation for future learning'. Preparation for future learning (PFL) is understood to be the capacity to learn new information, to use resources effectively and innovatively, and to invent new strategies for learning and problem solving in practice. Education researchers have developed study designs that use dynamic assessments to measure what trainees have acquired in the past, as well as what they are able to learn in the present. More recently, researchers have also started to emphasise and measure whether and how trainees take action to gain the information they need to learn. Knowing that there are study designs and emerging metrics for assessing PFL, the next question is how to design instruction that helps trainees develop PFL capacities. Although research evidence is still accumulating, the current evidence base suggests training that encourages 'productive failure' through guided discovery learning (i.e. where trainees solve problems and perform tasks without direct instruction, though often with some form of feedback) creates challenging conditions that enhance learning and equip trainees with PFL-related behaviours. Preparation for future learning and the associated capacity of being adaptive as one learns in and from training and clinical practice have been missed in most contemporary training and assessment systems. We propose a research agenda that (i) explores how real-world adaptive expert activity unfolds in the health care workplace to inform the design of instruction for developing PFL, (ii) identifies measures of behaviours that relate to PFL, and (iii) addresses potential sociocultural barriers that limit clinicians' opportunities to learn from their daily practice.

Effects of Comparing Contrasting Cases on Learning From Subsequent Explanations

In an experiment, prior to processing instructional explanations N = 75 students received either (a) contrasting cases plus comparison prompts, (b) contrasting cases plus provided comparisons (i.e., model answers to the comparison prompts), or (c) no preparation intervention. We found that the learners with preparation intervention learned more and with a higher degree of efficiency, perceived less extraneous load, and experienced a higher feeling of smooth automatic running while they processed the explanations than the learners without a preparation intervention. These findings suggest that comparing contrasting cases serves a focusing function. Furthermore, we found that the learners in the provided comparisons condition acquired more conceptual knowledge from the explanations than the learners in the prompted comparisons condition. This result indicates that providing high amounts of instructional guidance while learners compare contrasting cases can have an added value in comparison to providing comparison prompts concerning the resulting preparation for future learning.

Preparing medical students for future learning using basic science instruction.

The construct of 'preparation for future learning' (PFL) is understood as the ability to learn new information from available resources, relate new learning to past experiences and demonstrate innovation and flexibility in problem solving. Preparation for future learning has been proposed as a key competence of adaptive expertise. There is a need for educators to ensure that opportunities are provided for students to develop PFL ability and that assessments accurately measure the development of this form of competence. The objective of this research was to compare the relative impacts of basic science instruction and clinically focused instruction on performance on a PFL assessment (PFLA). This study employed a 'double transfer' design. Fifty-one pre-clerkship students were randomly assigned to either basic science instruction or clinically focused instruction to learn four categories of disease. After completing an initial assessment on the learned material, all participants received clinically focused instruction for four novel diseases and completed a PFLA. The data from the initial assessment and the PFLA were submitted to independent-sample t-tests. Mean±standard deviation [SD] scores on the diagnostic cases in the initial assessment were similar for participants in the basic science (0.65±0.11) and clinical learning (0.62±0.11) conditions. The difference was not significant (t[42]=0.90, p=0.37, d=0.27). Analysis of the diagnostic cases on the PFLA revealed significantly higher mean±SD scores for participants in the basic science learning condition (0.72±0.14) compared with those in the clinical learning condition (0.63±0.15) (t[42]=2.02, p=0.05, d=0.62). Our results show that the inclusion of basic science instruction enhanced the learning of novel related content. We discuss this finding within the broader context of research on basic science instruction, development of adaptive expertise and assessment in medical education.

Generalizing automated detection of the robustness of student learning in an intelligent tutor for genetics.

Recently, there has been growing emphasis on supporting robust learning within intelligent tutoring systems, assessed by measures such as transfer to related skills, preparation for future learning, and longer term retention. It has been shown that different pedagogical strategies promote robust learning to different degrees. However, the student modeling methods embedded within intelligent tutoring systems remain focused on assessing basic skill learning rather than robust learning. Recent work has proposed models, developed using educational data mining, that infer whether students are acquiring learning that transfers to related skills, and prepares the student for future learning (PFL). In this earlier work, evidence was presented that these models achieve superior prediction of robust learning to what can be achieved by traditional methods for student modeling. However, using these models to drive intervention by educational software depends on evidence that these models remain effective within new populations. To this end, we analyze the degree to which these detectors remain accurate for an entirely new population of high school students. We find limited evidence of degradation for transfer. More degradation is seen for PFL. This degradation appears to occur in part because it is generally more difficult to infer this construct within the new population.

Development of concept-based physiology lessons for biomedical engineering undergraduate students

Physiology is a core requirement in the undergraduate biomedical engineering curriculum. In one or two introductory physiology courses, engineering students must learn physiology sufficiently to support learning in their subsequent engineering courses and careers. As preparation for future learning, physiology instruction centered on concepts may help engineering students to further develop their physiology and biomedical engineering knowledge. Following the Backward Design instructional model, a series of seven concept-based lessons was developed for undergraduate engineering students. These online lessons were created as prerequisite physiology training to prepare students to engage in a collaborative engineering challenge activity. This work is presented as an example of how to convert standard, organ system-based physiology content into concept-based content lessons.

Problem-based Learning Across the Curriculum: Exploring the Efficacy of a Cross-curricular Application of Preparation for Future Learning

The research reported in this paper explores the applicability and efficacy of a variant of problem-based learning, the Preparation for Future Learning (PFL) approach, to teaching and learning within the context of a cross-curricular, middle school data literacy unit called Thinking with Data (TWD). A quasi-experimental design was used to compare pre-to-post-test data literacy gains of seventh grade students participating in the TWD unit with other seventh graders in two middle schools in northeast Ohio. Results show statistically significant differences between the two groups. Taken together with participant comments, the findings suggest that the PFL approach can be effectively implemented across subject areas to support the development of data literacy.

Motivation and Transfer: The Role of Mastery-Approach Goals in Preparation for Future Learning

The study of knowledge transfer rarely draws upon motivational constructs in empirical work. We investigated how students' achievement goals interact with different forms of instruction to promote transfer, defined as preparation for future learning (Bransford & Schwartz, 1999) Students were given either invention or tell-and-practice activities when learning statistics concepts and their achievement goal orientations were measured at the beginning of the experiment. We also assessed students' goals during the learning activity. We predicted that students who entered the experiment with a high mastery-approach goal orientation would be more likely to transfer, regardless of instruction. We also hypothesized that invention activities would lead to higher mastery-approach goal adoption for the task and more attention to important conceptual features, as students would focus on trying to understand the material. Finally, because we expected that invention activities would promote mastery goal adoption during the task, we predicted a moderating effect of invention activities, such that there would be a smaller effect for students' initial mastery-approach goal orientation on transfer for those who invented compared to those who received tell-and-practice instruction. All three hypotheses were supported. Results are discussed in terms of contributions to research on knowledge transfer, achievement goals, and educational practice.

Sequential effects of high and low instructional guidance on children’s acquisition of experimentation skills: Is it all in the timing?

We report the effect of different sequences of high vs low levels of instructional guidance on children’s immediate learning and long-term transfer of simple experimental design procedures and concepts, often called “CVS” (Control of Variables Strategy). Third-grade children (N = 57) received instruction in CVS via one of four possible orderings of high or low instructional guidance: high followed by high (HH), high followed by low (HL), low followed by high (LH), and low followed by low (LL). High guidance instruction consisted of a combination of direct instruction and inquiry questions, and low guidance included only inquiry questions. Contrary to the frequent claim that a high degree of instructional guidance leads to shallow learning and transfer, across a number of assessments—including a 5-month post-test—the HH group demonstrated a stronger understanding of CVS than the LL group. Moreover, we found no advantage for preceding high guidance with low guidance. We discuss our findings in relation to perspectives advocating “invention as preparation for future learning”, and the efficacy of “productive failure”.