Design-based Research Study Research Articles

Research: Understanding English Teachers’ Ideological Becoming in the Work Toward Linguistic Justice

In this article, we explore the ideological becoming (Bakhtin, 1981) of secondary and college English teachers as they participated in professional learning communities and later codesigned pedagogical innovations that aimed to further develop teachers’ and students’ critical language awareness. Drawing on qualitative data from two design-based research studies, our cases demonstrate the impact of hegemonic and counter-hegemonic authoritative discourses as well as diverse internally persuasive discourses on the participating teachers’ ideological becoming. Our cases also illustrate the complicated and contradictory nature of developing critically conscious internally persuasive discourses. The findings suggest the importance of sustained professional learning across a teaching life if we are truly committed to working toward linguistic justice in schools and communities.

Theorising With Sociomateriality: Interdisciplinary Collaboration in Socio-Technical Learning Environments

In this paper, we explore the possibilities offered by sociomateriality for academics to engage with complex learning environments. The focus is on a longitudinal design-based research (DBR) study that includes an interdisciplinary, collaborative student project between Information Systems (IS) and Urban Planning (URP) from two different higher education institutions in Cape Town, South Africa. In the project, student groups collaborate to find potential digital innovations for sustainability challenges in their local communities. The aim is to position the student as an active community member with intimate knowledge of local sustainability challenges, and to develop social digital innovations for the benefit of local communities. We apply sociomateriality as a theoretical lens to rethink socio-technical learning environments and propose four pedagogical propositions of relationality, reflexivity, responsiveness, and recognition to guide the pedagogical decision-making when designing complex learning environments. We conclude the paper by mapping student reflections and experiences to the four pedagogical propositions to illustrate how the theoretical sociomaterial elements translate into the learning environment.

Do project-based learning, hands-on activities, and flipped teaching enhance student's learning of introductory theoretical computing classes?

The need for computer science (CS) education, especially computer network education, is increasing. However, the challenges of teaching students with diverse backgrounds and engaging them in hands-on activities to apply theories into practices exist in CS education. The study addressed the challenges by using project-based learning (PBL) and flipped teaching approaches to cover both theoretical and hands-on learning aspects in CS education. This study aims to demonstrate the design and development journey of a CS course and examine whether using PBL, hands-on activities, and flipped teaching approaches improves students’ learning. The design-based research study was conducted in an undergraduate CS course from 2014 to 2020 at a midwestern university. The design and development trajectory in the six years were described. The descriptive statistics were used to analyze the trends of the course evaluation results, and ANOVA were conducted to examine whether the evaluation differs from each semester. The results indicated that using PBL, hands-on activities, and flipped teaching increased students’ learning motivation and their perceptions of their learning. Combining PBL and flipped teaching appropriately can enhance students’ learning motivation and perceived learning in CS education, but further research is needed to examine how each individual intervention influence students’ learning motivation and learning outcomes.

Supporting collaborative classroom networks through technology: An actor network theory approach to understanding social behaviours and design

AbstractThis paper presents an implementation of Connected Spaces (CxS)—an ambient help seeking interface designed and developed for a project‐based computing classroom. We use actor network theory (ANT) to provide an underutilized posthumanist lens to understand the creation of collaborative connections in this Computational Action‐based implementation. Posthumanism offers an emerging and critical extension to sociocultural perspectives on understanding learning, by pushing us to decenter the human, and consider the active roles that human and non‐human entities play in learning environments by actively shaping each other. We analyse how students in this class adjusted their help‐seeking and collaborative habits following the introduction of CxS, a tool designed to foster (more inter‐group) collaboration. ANT proposes generalized symmetry—a principle of considering human, non‐human and more than human entities with equivalent and comparable agency, leading to describing phenomena as networks of actors in different evolving relationships with each other. Analysing collaborative interactions as fostered by CxS using an ANT approach supports design‐based research—an iterative design revision process highlighting understandings about design as well as learning—by providing a temporal and informative lens into the relationship between actors and tools within the environment. Our key findings include a framing of technologies in classrooms as bridging agentic gaps between students and becoming actors engaging in different behaviours; learners enacting new agencies through technologies (for instance a more comfortable non‐intrusive help seeker), and the need for voicing and teachers to connect help networks in CxS equipped classrooms. Practitioner notesWhat is already known about this topic Collaborative learning is a valuable skill and practice; opportunities to mentor others are critical in empowering minoritized learners, especially in STEM and computing disciplines. School norms solidify a power and expertise hierarchy between teachers and learners and fail to productively support learners in learning from each other. Additionally, lack of awareness about peers' knowledge is a common hindrance in students knowing who to ask for help and how. What this paper adds An example of a designed interface called Connected Spaces with potential to foster more inter‐student collaboration, especially outside of mandated within‐group collaboration—in the form of cross‐group help seeking and help giving. A design based research study using actor network theory highlighting the limitations of Connected Spaces in sparking notable behaviour change among students by itself but being retooled as a teacher support tool in enabling cross‐group collaborations. Presenting conceptions of collaboration through technologies as bridging agentic gaps and acting with new agencies in performing help‐seeking related actions. Provoking the idea of testing emerging technologies in classrooms along with sharing our analyses and reflections with the classroom as a key idea in computing education—surfacing the gap between designed intentions and the different kinds of extra social work needed in the on‐ground success of different technologies. Implications for practice and/or policy Designers and researchers should create and test more interfaces alongside teachers across different classrooms and contexts aimed at supporting different kinds of voluntary collaborative interactions. Curricula, standards and school practices should further center providing students with opportunities to engage as mentors and build communities of learning across disciplines to empower minoritized students. Researchers engaging in design based research should consider using more posthumanist lenses to examine educational technologies and how they affect change in learning environments.

Developing Mathematics and Science Teachers’ Ability to Design for Active Learning: A Design-based Research Study

This paper describes an approach to working with secondary preservice mathematics and science (M&S) teachers to develop their ability to design for active learning. It presents the design of a studio-style intervention that augments existing teacher education. It describes the way that these studios can be organised, with specific suggestions that a specialised learning designer, a subject matter expert, and administrative support be included to aid in the design for learning—on the justification that this can both improve the learning design as well as advance teacher learning. It describes a study in which 10 secondary M&S preservice teachers experienced this style of studio, through iterations of learning design sessions and teaching practice. The studio differs from existing models (such as the ‘clinical model’) through its focus on learning design, the structure of the learning network, and the way that it augments (rather than replaces) existing teacher education. The paper presents results from the study in terms of teacher self-efficacy and self-reported perceptions. It discusses a set of design principles that emerged through the process of developing and testing this model and proposes considerations for researchers or teacher educators looking to use a similar approach in future by focusing on the roles, tasks, and activities for members within the network.

Contextual Conversational Agent to Address Vaccine Hesitancy: Protocol for a Design-Based Research Study.

BackgroundSince the beginning of the COVID-19 pandemic, people have been exposed to misinformation, leading to many myths about SARS-CoV-2 and the vaccines against it. As this situation does not seem to end soon, many authorities and health organizations, including the World Health Organization (WHO), are utilizing conversational agents (CAs) in their fight against it. Although the impact and usage of these novel digital strategies are noticeable, the design of the CAs remains key to their success.ObjectiveThis study describes the use of design-based research (DBR) for contextual CA design to address vaccine hesitancy. In addition, this protocol will examine the impact of DBR on CA design to understand how this iterative process can enhance accuracy and performance.MethodsA DBR methodology will be used for this study. Each phase of analysis, design, and evaluation of each design cycle inform the next one via its outcomes. An anticipated generic strategy will be formed after completing the first iteration. Using multiple research studies, frameworks and theoretical approaches are tested and evaluated through the different design cycles. User perception of the CA will be analyzed or collected by implementing a usability assessment during every evaluation phase using the System Usability Scale. The PARADISE (PARAdigm for Dialogue System Evaluation) method will be adopted to calculate the performance of this text-based CA.ResultsTwo phases of the first design cycle (design and evaluation) were completed at the time of this writing (April 2022). The research team is currently reviewing the natural-language understanding model as part of the conversation-driven development (CDD) process in preparation for the first pilot intervention, which will conclude the CA’s first design cycle. In addition, conversational data will be analyzed quantitatively and qualitatively as part of the reflection and revision process to inform the subsequent design cycles. This project plans for three rounds of design cycles, resulting in various studies spreading outcomes and conclusions. The results of the first study describing the entire first design cycle are expected to be submitted for publication before the end of 2022.ConclusionsCAs constitute an innovative way of delivering health communication information. However, they are primarily used to contribute to behavioral change or educate people about health issues. Therefore, health chatbots’ impact should be carefully designed to meet outcomes. DBR can help shape a holistic understanding of the process of CA conception. This protocol describes the design of VWise, a contextual CA that aims to address vaccine hesitancy using the DBR methodology. The results of this study will help identify the strengths and flaws of DBR’s application to such innovative projects.

Promoting STEAM Education in Primary School through Cooperative Teaching: A Design-Based Research Study

The COVID-19 pandemic has highlighted the importance of students’ information literacy, computer skills, and research competencies for self-regulated learning and problem solving. STEAM education, with interdisciplinary knowledge building and higher-order thinking development as its main purpose, is considered essential for students’ sustainable development in the post-pandemic era. However, STEAM education in China’s K-12 schools is facing several problems, such as insufficient qualified teachers, unsustainable development, and difficulty in achieving meaningful discipline integration. To address these problems, this study proposes an innovative STEAM education model supported by cooperative teaching and theories of project-based learning and collaborative learning. After two iterations of design, evaluation, and revision, the proposed STEAM education model and a set of instructional design principles were validated. The resulting model features a multi-teacher cooperative strategy, detailed and diverse scaffolding, familiar themes for students, the integration of STEAM education into formal curricula, and extended instruction hours. The study results suggest that cooperative teaching can facilitate meaningful discipline integration and can alleviate the STEAM faculty shortage. This study produced five proven instructional design principles for conducting STEAM education supported by cooperative teaching in primary schools.

Dialogue-and-Questioning Strategies in Art Classrooms and Museums

Art classrooms and museums are places where teachers and students talk about artworks. However, there is a lack of empirical research into dialogue—the most basic component of classroom teaching and the most used education strategy in museums. I investigated the development and experimentation of a dialogue-and-questioning framework for art classrooms and museums. I conducted a design-based research study with seven primary schoolteachers and 187 6th-grade students in Hong Kong. I found that the total number of questions asked by the teacher participants increased significantly. Teachers’ performance, when asking personal connection, observation, interpretation, and evaluation questions, also improved significantly. They became more conscious of relating artworks to the students in a personal way and developed a practice that fostered a more comprehensive understanding of artworks. Student participants began to approach artworks from different perspectives and engaged in more in-depth examinations.

Newly Qualified Teachers' Well-Being During the COVID-19 Pandemic: Testing a Social Support Intervention Through Design-Based Research.

Around the world, newly qualified teachers are leaving the profession after only a short time working at school. This not only has a negative effect on the capacities of the respective education systems, but also for the teachers themselves, as it often due to factors such as stress and burnout that leads to this decision. The COVID-19 pandemic has exacerbated this situation by adding to the teachers’ workload, uncertainty, and stress. Previous research has investigated strategies that may help teachers improve their well-being and, among other factors, found social support to be an important condition. In this mixed methods design-based research study, we developed a design to enhance social support among newly qualified teachers in their first months working at school. Our quantitative and qualitative results show that the design has positive effects on many aspects of teachers’ well-being in the intervention group both longitudinally (before and after the intervention) and when compared to a comparison group. The findings are being discussed considering the recent changes in the working conditions of teachers as imposed by the COVID-19 pandemic.

Integration of cooperative learning strategies in online settings

Although online learning has increased as a delivery method of instruction in higher education, learners may still feel isolated from the instructor and peers due to a lack of physical presence. Thus, intentional and purposeful online course design is necessary. To remediate feelings of isolation, cooperative learning strategies have been implemented in online courses, resulting in positive outcomes. A long-term cooperative learning project based on social interdependence theory (SIT) has been implemented into two asynchronous online courses at two different higher education institutions. A mixed-method, design-based research study was conducted to examine students’ attitudes towards cooperative learning. Participants of this study included undergraduate and graduate students who completed pre-and post-surveys. Classroom artifacts were also collected to analyze the group work and dynamics. Even though the quantitative results showed a decrease in students’ attitudes towards cooperative learning, qualitative data indicated that students benefited from this experience. Qualitative data also provided further insights on the group dynamics. Students’ high expectations of group work, faculty support, and shared sense of responsibility among group members could have affected their perceptions of cooperative learning. This study was the first cycle of a multi-cycle effort to develop a robust cooperative learning activity that will benefit learners in future courses.

Refining active learning design principles through design-based research

This design-based research (DBR) study had both local and general goals. Its local goal was to increase active learning in the online courses offered at a large research university in the midwestern United States. Its larger goal was to define active learning design principles for online courses in general, so that they might be used to improve the learning experience for wider audiences. While the principles of active learning can be applied to courses in any mode of delivery: flipped classroom, blended, or fully online, the importance of active learning in online courses is highlighted because active learning course design requires numerous upfront considerations. Moreover, because the pedagogical model is structured throughout the online learning environment and thus is made visible, online courses present a unique opportunity to review what is core to the principles of active learning. The design intervention (an innovative course review method) incorporated the principles of authentic e-learning. The study addressed two major research questions: (1) “To what extent does the intervention—a new course review method—indicate the extent to which active learning is present in the design of an online course?” and (2) “How do the principles of authentic e-learning incorporated in the new course review method need to be refined?” To address the first question, the online course review intervention was used to evaluate the learning activities and assessments of 75 undergraduate online courses against these authentic e-learning principles, resulting in an active learning (AL) score for each course. To address the second question, we surveyed the learners in these 75 courses about what made learning meaningful and coded the learners’ feedback in reference to the active learning design principles. The practical outcome of this DBR study is a pedagogical course review that quantifies active learning in online courses. The theoretical outcomes of this DBR study are refined active learning design principles that can serve instructors, designers, teacher educators, and administrators in enhancing the design of online courses. The findings of this study affirm that the authentic task principles as well as newly identified learner-centered design principles together can serve as evidence-based principles to define and refine active learning in online courses.

Voices of Playful Learning Experimental, Affective and Relational Perspectives across Social Education and Teacher Education

The purpose of the article is to expand on the knowledge of playful learning in higher education through a Design-Based Research study across Danish social education and teacher education. It aims to develop a conceptual framework for playful learning in boundary-crossing collaboration within higher education pedagogy, with the study's empirical analysis examining three distinct voices of playful learning of experimentation (e.g., explorative, open-ended, creative collaboration), affectivity (e.g., emotional, sensory, and atmospheric collaboration), and relations (e.g., cultural, democratic, and polyphonic collaboration). The voices are polyphonic, though they are all expressed as social, active, and experiential ways of knowing and learning situated in playful framings outside 'ordinary' taéaching and learning. Finally, the article discusses tensions in developing playful learning in boundary-crossing collaboration between paradoxical longings for both conceptual unity and diversity, amid control and openness, which influences both practical applications and theoretical implications of developing playful learning in adult higher education.

Redesigning for Equity and Achievement: Non-Leveled Guided Reading Instruction

Elementary school students are often placed into groups with peers of similar reading ability for leveled guided reading instruction. Through this practice, students are differentially exposed to reading skills, strategies, and texts that are presumed to match their reading ability. This widespread practice is problematic given that (1) current notions of matching early readers to texts for reading instruction are based on traditional instructional practice rather than reading science, (2) poor and minority students are overrepresented in the lowest ranked groups, (3) students in higher ranked groups make greater academic gains than those in lower ranked groups, and (4) teacher perceptions of students’ abilities are often inaccurate. Conversely, as supported by research, when students are presented with texts of increased difficulty and given appropriate instructional support, they are able to make accelerated reading progress. The purpose of this design-based research study was to develop innovative classroom practices and theoretical insights regarding the use of non-leveled guided reading instruction in order to support the reading achievement of all students. Qualitative data, in the form of fieldnotes, semi-structured interviews, and documents were collected. Data analysis included structural and process coding which resulted in the explication of five design principles to assist in the application of this design in other contexts. Specific attention is given to the technical, normative, and political aspects inherent in the dissemination and sustainability of the proposed design.

Virtual patients in clinical decision making – A design-based research approach

This paper reports on a longitudinal, design-based research (DBR) study to promote clinical decision making using a virtual patient (VP) simulation for emergency renal care. The VP was piloted with pharmacy students, then offered as an interprofessional learning exercise for pharmacy and medical students, before being introduced as part of the curriculum. In this paper, the DBR framework used to design, implement and evaluate the VP is described. The iterative changes made and implications for the integration of virtual patient simulation in the pharmacy curriculum are discussed.

Enhancing pre-service mathematics teachers’ understanding of function ideas

Function is a multifaceted and essential concept in mathematics that includes various complex ideas such as mapping, relations between variables, algebra, input-output, and rule. Pre-service mathematics teachers’ (PMTs) should have a rich understanding of these ideas for their future teaching practices. However, research showed that PMTs had a limited and superficial understanding of function as students do. Thus, a learning module was designed for improving PMTs’ conceptualizations of function ideas as they relate to their personal concept definitions and examples of functions. A design-based research study was conducted with 17 senior PMTs. The study results suggest an improvement in the way PMTs define functions and identify a variety of function ideas in definitions and examples. Even if the mapping idea became dominant among all ideas in PMTs’ personal concept definitions and examples, they could identify the implicit function ideas and develop an understanding of connections between ideas. We also provide suggestions for the second cycle of the intervention.

School-based Simulated Internships to support dialogic collaboration and authentic links with the world of work: a design-based research study

ABSTRACT Employers often complain that students leave school unequipped with the real-world skills needed, including problem-solving, teamwork and effective communication. Conversely, school-based education often suffers from limited perceived authenticity leading to low student engagement. Work experience is one solution, but it is labour-intensive and inequitably available. To address these challenges we undertook design-based research to explore a new relationship between enterprise and education: potentially scalable, curricular-integrated, simulated role-play experiences of the world of work. We developed a programme aligned to the English Key Stage 3 Computing and Design and Technology curricula (students aged 11–14). Student groups designed, modelled or built local solutions to global challenges, presented via videos from engineers in two international telecommunications companies. 326 students participated, led by eight teachers in four schools in areas of England traditionally associated with low social mobility. Findings identify structures, resources and approaches that authentically link to the world of work, whilst supporting students’ effective communication and shared group outcomes. We demonstrate proof of concept for an innovative education model made possible by the digital age. Using simulated real-world role-play scenarios, education across subjects could be made more authentic and many more students could experience working with leading-edge companies.

Educators as creators: lessons from a mechanical MOOC on educational dialogue for local facilitators

ABSTRACT This paper explores possible affordances of technology and online professional learning to develop and support communities of practice in which educational practitioners develop, share and build on one another’s reflections and learning. Evidence is presented from a design-based research study that iteratively designed and developed a mechanical MOOC on educational dialogue for local facilitators. Local facilitators are practitioners who take on a leadership role whereby they coordinate and support peers in their setting in developing their dialogic practices. The research employs mixed methods for collection and analysis of data from course participants, exploring the successes and challenges of online professional development courses within 10 thematic areas. Design principles are offered for each of these 10 themes for scalable and sustainable online professional learning programmes that promote practitioner reflection, agency and empowerment, and view educators as valuable creators and contributors to professional learning resources and environments.

Design principles for internet skills education: results from a design-based research study in higher education.

The current generation of students lives in a globally connected world where Internet technologies are ubiquitous. As a result, they learn how to use various digital tools from a very young age, although, for the most part, the skills they develop are not adequate to use internet technologies in academic settings effectively. Additionally, while digital skills are essential in Higher Education (HE), developing programs for the effective use of internet technologies is still an issue in question. Research lacks empirical investigations regarding the design of such programs. To address this gap, the authors applied a design-based research (DBR) methodology to empirically explore an instructional intervention that aimed to enhance undergraduate students’ digital skills for the effective use of the Internet during their studies. Specifically, the authors drew from multiple sources and utilized a triangulation approach to interpreting the findings emphasizing the aspects of digital skills development and assessment and learning design. The results clearly show that the project-based learning intervention and the proposed design principles can positively impact digital skills development and support learning in academic settings. The authors conclude with implications for further research in the field focusing on digital skills frameworks, assessment instruments, instructional approaches, and learning content.Supplementary InformationThe online version contains supplementary material available at 10.1007/s43545-022-00428-2.

Conducting counseling sessions competently

Counseling in the sense of a helpful and reflective conversation is a challenging form of action and at the same time an expression of pedagogical professionalism. Taking on counseling tasks in everyday school life and teaching is part of the professional role and the educational mission. In order to fulfil the counseling-related requirements, teachers need counseling knowledge and methods as well as a strong self-awareness and foreign perception such as a highly developed ability to reflect. However, there is still a lack in vocational teacher training, concerning the systematic and comprehensive teaching of these counseling-related skills. The article provides insight into the development and evaluation of a holistic seminar concept to strengthen just these competences. It is part of a design-based research study in vocational and business education to strengthen job-related self-awareness and self-reflection within the first phase of teacher training. The course “Conducting counseling sessions competently” can be understood as a prototype that is used to examine how counseling can be promoted on a microdidactic level. First evaluation results demonstrate how the students perceived and experienced the seminar.

Progress-Oriented Workshops for Doctoral Well-being: Evidence From a Two-Country Design-Based Research

Aim/Purpose: This paper explores an intervention approach (in the form of workshops) focusing on doctoral progress, to address the problems of low emotional well-being experienced by many doctoral candidates. Background: Doctoral education suffers from two severe overlapping problems: high dropout rates and widespread low emotional well-being (e.g., depression or anxiety symptoms). Yet, there are few interventional approaches specifically designed to address them in the doctoral student population. Among structural, psychosocial, and demographic factors influencing these problems, the self-perception of progress has emerged recently as a crucial motivational factor in doctoral persistence. Methodology: This paper reports on an iterative design-based research study of workshop interventions to foster such perception of progress in doctoral students’ everyday practice. We gathered mixed data over four iterations, with a total of 82 doctoral students from multiple disciplines in Spain and Estonia. Contribution: An approach to preventive interventions that combines research-backed education about mental health and productivity, peer sharing and discussion of experiences, and indicators of progress, as well as self-tracking, analysis, and reflection upon everyday evidence of their own progress. The paper provides initial evidence of the effectiveness of the proposed interventions, across two institutions in two different countries. Further, our data confirms emergent research on the relationships among progress, emotional well-being, and dropout ideation in two new contexts. Finally, the paper also distills design knowledge about doctoral interventions that focus on progress, relevant for doctoral trainers, institutions, and researchers. Findings: Our quantitative and qualitative results confirm previous findings on the relationships among progress, burnout, and dropout ideation. Our iterative evaluation of the workshops also revealed a large positive effect in students’ positive psychological capital after the workshops (Cohen’s d=0.83). Our quantitative and qualitative analyses also started teasing out individual factors in the variance of these benefits. Recommendations for Practitioners: Intervention design guidelines for doctoral trainers include: focusing on actionable productivity and mental health practices, the use of activities targeting perception biases and taboos, or the use of active practices and real (anonymous) data from the participants to make progress visible and encourage reflection. Recommendation for Researchers: The construct of progress, its components, and its relationships with both emotional well-being and doctoral dropout need to be more deeply studied, using multiple methods of data collection, especially from more frequent, ecologically valid data sources (e.g., diaries). Impact on Society: The proposed interventions (and focusing on doctoral progress more generally) hold promise to address the current emotional well-being and dropout challenges facing hundreds of thousands of doctoral students worldwide, ultimately helping increase the research and innovation potential of society as a whole. Future Research: More rigorous evaluative studies of the proposed approach need to be conducted, with larger samples and in other countries/contexts. Aside from the proposed one-shot training events, complementary longitudinal interventions focusing on supporting everyday progress and reflection throughout the doctoral process should be trialed.