Instructional Design Research Research Articles

Going beyond the comparison: toward experimental instructional design research with impact.

To design effective instruction, educators need to know what design strategies are generally effective and why these strategies work, based on the mechanisms through which they operate. Experimental comparison studies, which compare one instructional design against another, can generate much needed evidence in support of effective design strategies. However, experimental comparison studies are often not equipped to generate evidence regarding the mechanisms through which strategies operate. Therefore, simply conducting experimental comparison studies may not provide educators with all the information they need to design more effective instruction. To generate evidence for the what and the why of design strategies, we advocate for researchers to conduct experimental comparison studies that include mediation or moderation analyses, which can illuminate the mechanisms through which design strategies operate. The purpose of this article is to provide a conceptual overview of mediation and moderation analyses for researchers who conduct experimental comparison studies in instructional design. While these statistical techniques add complexity to study design and analysis, they hold great promise for providing educators with more powerful information upon which to base their instructional design decisions. Using two real-world examples from our own work, we describe the structure of mediation and moderation analyses, emphasizing the need to control for confounding even in the context ofexperimental studies. We also discuss the importance of using learning theories to help identify mediating or moderating variables to test.

Learning with videos: Do task instructions and the availability of a pause button matter?

AbstractBackgroundWhen watching educational online videos, learners need to determine whether the videos' contents are suitable for learning. Whereas this may induce metacognitive monitoring processes, it may also distract learners from the learning materials.ObjectivesIn the current set of experiments, we investigated whether asking participants to rate the suitability of three educational videos to impart knowledge (both experiments) and enabling participants to pause the video (Experiment 2) affects learning.MethodsExperiment 1 was conducted in the laboratory with a sample of university students. Participants were randomly assigned to one of two experimental conditions (rating task vs. viewing task). Experiment 2 was conducted online. Participants were randomly assigned to one of four conditions resulting from the two factors task (rating task vs. viewing task) and pause button (available vs. not available).Results and ConclusionIn Experiment 1, we observed detrimental effects of the rating task on learning outcomes, but more accurate judgements of learning. In Experiment 2, we did not find any effects of the rating task on learning outcomes and the accuracy of the participants' judgements of learning. However, the inclusion of a pause button did result in more accurate judgements of learning. Further, exploratory analyses revealed that older participants reported higher levels of intrinsic and germane cognitive load than the younger participants. This increased effort only translated into better learning outcomes in the condition in that participants could pause the video. Thus, age is introduced as a potential boundary condition that should be investigated in instructional design research.

Instructional design research trends towards digital transformation of education systems in ASEAN

Instructional design research trends towards digital transformation of education systems in ASEAN

Transforming Education in the World of Artificial Intelligence

Introduction: Artificial Intelligence (AI) and Machine Learning (ML) are key drivers of innovation and growth among all industries, and the education sector is no exemption. AI is considered as a powerful tool to facilitate new examples for technological development, instructional design and educational research that are otherwise not possible to develop in the traditional education techniques. With the development in information processing and computing techniques, artificial intelligence has been widely applied in educational practices (Artificial Intelligence in Education; AIEd), such as teaching robots, human-computer interactions intelligent tutoring systems, learning analytics dashboards and adaptive learning systems. It has the ability to maximize both teaching and learning, helping the education sector to evolve for better thus benefitting students and teachers both

KEPRAKTISAN ENSIKLOPEDIA FAMILI ANNONACEAE DI KEBUN RAYA BANUA UNTUK MELATIHKAN KETERAMPILAN BERPIKIR KRITIS MAHASISWA

Students' critical thinking skills are still very low. Development research is carried out to improve the quality of the product under development, namely the encyclopedia. An encyclopedia is learning material that includes descriptions and pictures to make topics clearer. Each statement is listed in alphabetical order for ease of use. This study aims to describe the viability of the Annonaceae family in the Botanical Garden of Banua. This study uses the developmental research type of instructional design research with Tessmer's formative assessment design. The personality test subjects were four students and the small group test subjects were four students who took the Phanerogamae course. Data were obtained from different research instruments on the practicality of content and the practicality of expectations. The results of the encyclopedic study of the family Annonaceae at the Botanical Garden of Banua on the practicality of the contents received a good category, because it received a very good category for its structure, attractiveness, and practicality because it is easy to use, and has received positive feedback from students.

Frontiers and Trends of Blended Learning Research in China Based on Visualization Analysis of CNKI Database

In this paper, CiteSpace is used to conduct metrological and visual analysis of the core journals of blended learning research (2003-2021) collected by the China National Knowledge Infrastructure (CNKI). The results show that the number of studies on blended learning in China is increasing year by year, which indicates that the research on blended learning continues to attract attention and that blended learning is not yet mature. The research hotspots include the basic theory research of blended learning, teaching design research, learning resources and platform construction, and application practice research. The research frontiers include analysis and application research based on a specific learning platform, application research of blended learning in a certain field, and instructional design research. The development trend is changing from basic theory research to teaching application practice from focusing on teachers' teaching to students' learning.

Ethnomathematics in Sundanese Culture from Scopus Database: Systematic Literature Review

Ethnomathematics has also been shown to have a positive impact on students' academic development, including improved creative thinking, understanding of geometry, and algebraic skills. However, there are challenges in implementing ethnomathematics in Sundanese culture, and more research is needed to understand these difficulties and potential solutions. This literature review aims to examine the current state of research on Sundanese ethnomathematics, including definitions and characteristics of ethnomathematics used in previous studies, as well as methodological challenges and potential applications. The review is based on a systematic search of leading mathematics education journals. This research explores the use of Sundanese ethnomathematics in education and cultural understanding, utilizing a variety of research objectives and methods, including didactic design analysis, instructional design research, and ethnographic field study. The results indicate that incorporating cultural context and traditional practices, such as the use of religious symbols and specialized teaching materials, can improve students' understanding and learning of mathematics. It is suggested that educators consider incorporating elements of Sundanese ethnomathematics into their teaching practices and that further research be conducted on the impact of ethnomathematics on students' academic, social, and physical development, as well as the effectiveness of different teaching methods in various cultural settings.

Online Open Course Blended Learning Instructional Design Research.

In view of the existing teaching design problems such as inaccurate analysis of learning situation, insufficient flexibility of teaching presupposition, insufficient adaptability of situation design, insufficient interaction of activity design, and unreasonable evaluation design, this study is based on the blended learning teaching structure and process. A staged and hierarchical online and offline hybrid teaching design framework is constructed. The teaching design framework mainly includes four aspects: pre-class pre-set and learning situation diagnosis analysis design, in-class situation creation and interactive implementation teaching design, after-class expansion and migration teaching design, and diversified teaching evaluation design with equal emphasis on process and results. To "recognize the material", accurately design teaching, "teaching" efficiently, and evaluate objectively and comprehensively.

How do higher education students regulate their learning with video modeling examples, worked examples, and practice problems?

Presenting novices with examples and problems is an effective and efficient way to acquire new problem-solving skills. Nowadays, examples and problems are increasingly presented in computer-based learning environments, in which learners often have to self-regulate their learning (i.e., choose what type of task to work on and when). Yet, it is questionable how novices self-regulate their learning from examples and problems, and to what extent their choices match with effective principles from instructional design research. In this study, 147 higher education students had to learn how to solve problems on the trapezoidal rule. During self-regulated learning, they were free to select six tasks from a database of 45 tasks that varied in task format (video examples, worked examples, practice problems), complexity level (level 1, 2, 3), and cover story. Almost all students started with (video) example study at the lowest complexity level. The number of examples selected gradually decreased and task complexity gradually increased during the learning phase. However, examples and lowest level tasks remained relatively popular throughout the entire learning phase. There was no relation between students' total score on how well their behavior matched with the instructional design principles and learning outcomes, mental effort, and motivational variables.

Instructional design learners make sense of theory: a collaborative autoethnography

Understanding theory is essential to instructional design (ID) research and practice; however, novice designers struggle to make sense of instructional design theory due to its abstract and complex nature, the inconsistent use of theoretical terms and concepts within literature, and the dissociation of theory from practice. While these challenges are generally understood, little is known about the sensemaking process of learners as they encounter these challenges in pursuit of deeper theoretical understanding. Using a collaborative autoethnographic approach, six ID learners investigated their sensemaking experience within an advanced ID theory course. Autoethnography, a form of qualitative research, focuses on self-reflection “to gain an understanding of society through the unique sense of self” (Chang et al., 2013, p. 18). Collaborative autoethnography, a type of autoethnography, explores anecdotal and personal experiences “collectively and cooperatively within a team of researchers” (p. 21). Using individual and collective reflexive and analytic activities, this inquiry illuminates the numerous sensemaking approaches ID learners commonly used to move beyond their initial, basic theoretical understanding, including deconstructing theory, distinguishing terminology, integrating concepts with previous knowledge, and maintaining an openness to multiple perspectives. Additionally, ID learners experienced significant struggles in this process but viewed these struggles as significant and motivating elements of their sensemaking process. Finally, this study offers implications for learners, instructors, and course designers.

The Current State of Turkish STEM Researches: A Systematic Review Study

In the 21st century, STEM education is gaining importance day by day. In this study, the purpose was to reveal the content analysis of master's and dissertations conducted in the last five years in the field of Turkish Science STEM education system. A total of 117 theses and dissertations, 18 of which were dissertations and 99 of which were theses, were examined in terms of academic discipline, theoretical frameworks, instructional design models, research designs and models, research areas, statistical analyses, keywords, data collection tools, participants, variables/research focuses and related institutions. In this respect, the present study, which examined the theses and dissertations, is thought to be important with respect to revealing the current situation in the field of science education in Turkey and determining the research trends for researchers.

Policy Dialogue: Online Education as Space and Place

AbstractThe rise of online learning over the past few decades has raised fundamental questions about the kinds of “spaces” and “places” this mode of education creates. Do they support meaningful exchanges? Can they advance educational equity, access, and community-building? Are they comparable to in-person classroom experiences? The recent COVID pandemic and the global turn toward virtual learning in response have brought such questions into sharp relief. These were the questions and contextual factors that brought distinguished historian Carroll Pursell and international educational technology authority Toru Iiyoshi together for this policy dialogue. Their conversation takes readers on a wide-ranging discussion about the interplay between education, technology, and society writ large. And they offer insights into the past, present, and likely future of education in an era of accelerating technological change.Carroll Pursell is the Adeline Barry Davee Distinguished Professor of History (Emeritus) at Case Western Reserve University and Distinguished Honorary Professor of History at the Australian National University. He held faculty positions at the University of California at Santa Barbara and served as the Andrew W. Mellon Distinguished Professor of the Humanities at Lehigh University. Pursell is a fellow of the American Association for the Advancement of Science (AAAS), and former president of both the International Committee for the History of Technology (ICOHTEC) and the Society for the History of Technology (SHOT), which also awarded him its Leonardo da Vinci Medal for outstanding contributions to the history of technology.Toru Iiyoshi is professor and director at the Center for the Promotion of Excellence in Higher Education at Kyoto University. Previously, he was a senior scholar and director of the Knowledge Media Laboratory at the Carnegie Foundation for the Advancement of Teaching. He also served as senior strategist in the Office of Educational Innovation and Technology at Massachusetts Institute of Technology. Iiyoshi is a member of the World Economic Forum's Global Agenda Council on Technology and Education and past recipient of the Outstanding Practice Award in Instructional Development and the Robert M. Gagne Award for Research in Instructional Design from the Association for Educational Communications and Technology.HEQPolicy Dialogues are, by design, intended to promote an informal, free exchange of ideas between scholars. At the end of the exchange, we offer a list of references to readers who wish to follow up on sources relevant to the discussion.

Classification of Problem and Solution Strings in Scientific Texts: Evaluation of the Effectiveness of Machine Learning Classifiers and Deep Neural Networks

One of the central aspects of science is systematic problem-solving. Therefore, problem and solution statements are an integral component of the scientific discourse. The scientific analysis would be more successful if the problem–solution claims in scientific texts were automatically classified. It would help in knowledge mining, idea generation, and information classification from scientific texts. It would also help to compare scientific papers and automatically generate review articles in a given field. However, computational research on problem–solution patterns has been scarce. The linguistic analysis, instructional-design research, theory, and empirical methods have not paid enough attention to the study of problem–solution patterns. This paper tries to solve this issue by applying the computational techniques of machine learning classifiers and neural networks to a set of features to intelligently classify a problem phrase from a non-problem phrase and a solution phrase from a non-solution phrase. Our analysis shows that deep learning networks outperform machine learning classifiers. Our best model was able to classify a problem phrase from a non-problem phrase with an accuracy of 90.0% and a solution phrase from a non-solution phrase with an accuracy of 86.0%.

The history of an English-speaking Canadian distance university: the Athabasca University - An interview with Nancy K. Parker

In her interview, Nancy Parker outlines the origins of Athabasca University and its purpose. She describes the internal and external pressures the university has had to face over the years to become a fully online institution. Athabasca University's unique features are portrayed throughout the interview, to include serving rural and adult learners, emphasizing learning rather than teaching, using ongoing pedagogical research in instructional design to develop online content, committing to equality in education for adult learners through an open and rolling admission process, a high level of web-enabled self-service tools and call centres, and empowering students to create learning communities beyond physical and virtual boundaries.

Three Contrasting Pairs’ Collaborative Programming Processes in China’s Secondary Education

Pair programming is a collaborative learning mode to foster novice learners’ computer programming. Previous empirical research has reported contrasting conclusions about the effect of pair programming on student learning. To further understand students’ pair programming, this study uses a mixed method to analyze three contrasting pairs’ collaborative behaviors, discourses, and perceptions from a multi-dimensional perspective. The analysis results show that the high-ranked student pair is characterized as the interactive, socially-supportive, and goal-oriented pair; the middle-ranked student pair is characterized as the highly-interactive, socially-supportive, and process-oriented pair; and the low-ranked student pair is characterized as the lowly-interactive, socially-unsupportive, and programming-distracted pair. The research reveals complex relations between collaborative behaviors, discourses, and performances, which have critical influences on students’ pair programming quality. Based on the results, this research proposes pedagogical, analytical, and theoretical implications for future instructional design, learning analytics, and empirical research of collaborative programming.

Artificial intelligence innovation in education: A twenty-year data-driven historical analysis

Reflecting on twenty years of educational research, we retrieved over 400 research article on the application of artificial intelligence (AI) and deep learning (DL) techniques in teaching and learning. A computerised content analysis was conducted to examine how AI and DL research themes have evolved in major educational journals. By doing so, we seek to uncover the prominent keywords associated with AI-enabled pedagogical adaptation research in each decade, due to the discipline’s dynamism. By examining the major research themes and historical trends from 2000 to 2019, we demonstrate that, as advanced technologies in education evolve over time, some areas of research topics seem have stood the test of time, while some others have experienced peaks and valleys. More importantly, our analysis highlights the paradigm shifts and emergent trends that are gaining prominence in the field of educational research. For instance, the results suggest the decline in conventional tech-enabled instructional design research and the flourishing of student profiling models and learning analytics. Furthermore, this paper serves to raise awareness on the opportunities and challenges behind AI and DL for pedagogical adaptation and initiate a dialogue.

Discipline-Based Education Research for Animal Welfare Science.

Animal welfare science features interdisciplinary and collaborative working across fields, spanning behavioural ecology, psychology, veterinary sciences, economics, and fundamental biology. However, education research is not yet prevalent within the animal welfare literature. In a Web of Science topic search there were 188 papers which specifically discussed or explored how to teach animal welfare from 1978 to 2017. Of these, only 34% (n = 61) specifically focused on instructional design or pedagogical research, and these were predominantly within veterinary education (57%). Despite this, the literature is in broad agreement that animal welfare education is an important topic that should be done well. Within the UK, there were a possible 586 animal-related courses within Universities College Admissions Service database for potential students to choose from, highlighting the significance of robust and considered educational practice. The current gaps identified in the literature were discussion of hidden curriculums outside of veterinary degrees, animal-centered education, the blueprinting of assessment, and authentic assessment. Therefore, this review proposes that animal welfare scientists interested in education consider discipline based educational research (DBER) practices, and engage more fully with the educational research literature. A key component of DBER is the recognition that specialist knowledge needs to be taught by specialists, and so it is important that animal welfare scientists begin to access educational research too.

Learning fractions with and without educational technology: What matters for high-achieving and low-achieving students?

Instructional design research promotes interactive and adaptive scaffolds as features of educational technology. Mathematics education research can guide elaborated fractions curricula to develop basic fraction concepts while challenging the natural number bias. Thus, we developed theory-grounded interactive material for learning fractions providing scaffolds in an eBook. Evaluating both, curriculum and scaffolds, we split 745 high-achieving and 260 low-achieving 6th graders into three groups: Scaffolded Curriculum group (using the eBook on iPads), Curriculum group (using a paper copy of our developed material), and Traditional group (using conventional textbooks). Generalized linear mixed models revealed diverse positive effects on the achievement of students in the experimental conditions: Results showed that high-achieving students did benefit from the curriculum, regardless of whether it was presented with or without scaffolds, while for low-achieving students using scaffolds was decisive. This suggests that interactive and adaptive scaffolds can support students in learning mathematical concepts, especially for low-achieving students.

Promoting Pedagogical Agility in Learning Spaces: Toward a Comprehensive Framework of Faculty Support and Innovation

Postsecondary instructors routinely face novel and complex challenges in physical classrooms and informal learning spaces. Instructors often bring these challenges, along with creative and aspirational solutions, to the attention of centers for teaching and learning (CFTL). Issues span a wide range of topics including blogs, clickers, immersive experiences, active learning, learning analytics, and more. We embrace these challenges and seek to co-create solutions by providing a wide net of resources and support characterized by: (1) Instructional technologies (2) Instructional design, (3) Faculty development, and (4) Research. These elements emerge as a generalizable framework that represents a dynamic research-to-practice cycle. The cycle begins with a combination of problem definition and existing research. An approach is then planned and executed that includes instructional technologies, instructional design, faculty development, and original research. In accord with the cyclical nature of the framework, research findings inform development of future instructional design and faculty development opportunities. These, in turn, inform future practice, and the cycle continues. In our CFTL an educational research team collaborates with an instructional design and development team to support and facilitate this research-to-practice cycle. In this manuscript, we illustrate the practical implementation of this recursive and generalizable framework as we report on a case study of one technology-enhanced experimental classroom space. We conclude with a discussion of how the framework might inform larger efforts to integrate research with instructional technology implementation, instructional design, and faculty development.

Designing and Developing Videos for Online Learning: A Seven-Principle Model

Despite the ubiquitous use of instructional videos in both formal and informal learning settings, questions remain largely unanswered on how to design and develop video lessons that are often used as the primary method for delivering instruction in online courses. In this study, we experimented with a model of seven principles drawn from instructional design theories for designing and developing video lessons for an online graduate course. Feedback was collected from students through surveys on their perceptions of the effectiveness of the video lessons and the overall course quality for eight semesters. This paper shares the instructors’ experience on the design and development of the video lessons as well as the survey findings. Implications of the findings for instructional design and future research are also discussed.