Design-based Research Methodology Research Articles

Developing virtual collaborative health team educational environments

In this short paper we introduce a conceptual framework that is under development to create virtual educational environments to simulate collaborative health team experiences. Building on our work of developing virtual environments for authentic Paramedicine education scenarios, we are extending the concept across the seven health disciplines at the university, beginning initially with a prototype involving three health discipline teams: Paramedicine, Nursing, and Physiotherapy. Using a design based research methodology we are developing prototypes of immersive simulated environments to simulate the real - world interaction between these three health teams for our students. We leverage a low cost mobile BYOD approach enabling rapid prototyping and development of these scenarios.

CMALT cMOOC

This paper outlines the design stage of a project that reimagines lecturer professional development around a network of communities of practice scaffolded by a cMOOC (connectivist Massive Open Online Course), where sustained collaborative engagement with innovative teaching practice is recognised via established international peer-based professional accreditation pathways such as CMALT (Certified Member of the Association for Learning Technology). Informed by a design based research methodology, the CMALT cMOOC leverages a network of national and international collaboration and innovative teaching expertise, providing an agile and scalable framework to support the development of participants’ CMALT portfolios as evidence of critical engagement with new modes of practice and enhanced student outcomes.

An ecosystem of knowledge: relationality as a framework for teachers to infuse Indigenous perspectives in curriculum

ABSTARCT New data is presented from two studies involving thirteen practising secondary teachers and twelve pre-service early childhood, primary and secondary teachers in Australia. The first study explored how non-Indigenous practising teacher identities, shaped by external and policy discourse, create obstacles to teachers’ willingness and confidence in infusing Indigenous perspectives in curriculum. With this knowledge in hand, the researchers utilised a Design-Based Research methodology to conduct a second study with pre-service (ITE) teachers, exploring the power of relationality as a framework to re-shape non-Indigenous pre-service teachers’ conceptualisation of racial and place-based identity. By enabling non-Indigenous pre-service teachers to construct an authentic connection to Indigenous ways of thinking and being, relatedness pedagogy increased pre-service teacher willingness and confidence to infuse Indigenous perspectives into their future teaching.

Design of a Pedagogical Model to Foster Ocean Citizenship in Basic Education

Following a design-based research methodology, this investigation develops a pedagogical model to foster ocean citizenship through the application of a design cycle consisting of four phases: (1) preliminary research, (2) planning, (3) action and (4) evaluation. This article presents the results of phases 1 and 2, which define the conceptual foundation of the pedagogical model, and the planning of actions for its implementation in the school environment. The conceptual foundation was established by drawing upon the theoretical principles of a systemic/complex approach to education, along with theoretical-methodological elements compiled from the literature in the field of ocean literacy and ocean citizenship. During the planning phase, six educational activities were defined, to be conducted as part of a citizen science project to monitor the coastal zone. This model was developed with the objective of going beyond theoretical concepts, to offer schools a practical and objective guide for fostering ocean citizenship in basic education.

How to Encourage Inclusion in a Qualitative Research Project Using a Design-Based Research Methodology

Many issues and challenges face research design and research teams that want to become more inclusive, especially in large-scale research projects involving many stakeholders. This article explores an approach called Design-Based Research (DBR). DBR has been widely used in education for several years; it emphasizes collaboration with the community and takes the context of participants into consideration. DBR is transposable to other disciplines and is intended to be inclusive of the diverse stakeholders involved in a research project. For instance, in an ongoing research project about unconscious bias and inclusive behaviors, it takes into account all stakeholders’ needs and involves them in all stages of the research, which is taking place in a real-world context rather than a laboratory. The aim of this article is to better understand how the DBR methodology enables the inclusion of historically marginalized groups and how it is applied in the field. This exploratory article will present an example of an ongoing research project using the DBR methodology to show how this approach can be more inclusive than experimental approaches. This exploration reveals the positive impact of DBR in implementing solutions that can help reduce inequalities and power relationships. It also reveals the complexity of conducting qualitative research in a social laboratory. In particular, it takes into account the specificity of each historically marginalized group, from an intersectional perspective, the difficulty of operating within a process where not everything is determined in advance, and the need for a researcher specializing in DBR. It is important to allow sufficient time and financial resources at each stage to recognize the involvement of community organizations. The tools and knowledge generated by this type of research project will be useful for other organizations and future research.

Augmented Reality in A Sustainable Engineering Design Context: Understanding Students’ Collaboration and Negotiation Practices

This study reports on the use of augmented reality (AR) within the context of sustainable engineering design education. The objective of this study is to understand students’ collaboration and negotiation practices in a sustainable engineering design context using AR. The technology used in this study includes MERGE Cube (a physical cube that acts as a digital canvas for AR) and CoSpaces Edu (an online platform for students to build 3D creations and animate them with code). There have been 48 instances of student participation from upper elementary to middle school in four iterations of this study since February 2022. The research was conducted based on a design-based research methodology, and the data was collected through qualitative methods and analyzed using the intra-action analysis method. This study’s outcome revealed that interactions among participant dyads and with the technology shed light on distinct dynamics within collaborative sustainability-oriented learning and design processes. These diverse interactions collectively emphasize the multifaceted nature of collaborative design, where individual experiences, communication styles, and technological proficiency all play integral roles in shaping the collaborative process. In addition, the results of our research showed that the complexities inherent in negotiating ownership and collaboration dynamics are influenced by individual attitudes, timing of involvement, and previous experiences. Given the importance of collaboration in achieving sustainability-oriented goals, these findings are relevant to the field of sustainable engineering education, especially when working with younger children.

Enhancing Statistical Physics Learning: Rhetoric and Emotion in Moodle for Physics Education

The Learning Management System in science education has become crucial in modern educational settings. However, there is a lack of comprehensive resources to guide the implementation of hedonic and pragmatic qualities in UX. This study aims to identify emotional design factors and adopt an innovative perspective with a rhetorical approach to enhance the user experience. This study adopts the Design-Based Research methodology using the UEQ questionnaire with 26 items, involving a total population of 122 students. Conducting research through a User Experience Questionnaire, rhetorical evaluation, and open-ended questions in three control groups, the physics learning experience through Moodle at the Sarjanawiyata Tamansiswa University was evaluated, specifically in the Physics Education study program. The research findings demonstrate that improving UX leads to higher user satisfaction. According to the results of the UEQ analysis, it is evident that attractiveness, clarity, and efficiency are rated above average. Meanwhile, aspects of dependability, stimulation, and novelty are assessed below average criteria. The study concludes that ethos, pathos, and logos are essential in embracing the pragmatic and hedonic aspects of UX.

Correction: Using a design-based research methodology to develop and study prompts integrated into GeoGebra to support mathematics learning of gifted students

Correction: Using a design-based research methodology to develop and study prompts integrated into GeoGebra to support mathematics learning of gifted students

Empathic communication training in healthcare using Virtual Patients

This project aims to build effective empathic communication training for healthcare students using conversational AI and Virtual Patients. An umbrella review of empathy training in healthcare will be used to create a framework for designing effective empathy training. We will investigate two different implementations of Virtual Patients through a pilot study with speech-language therapy students from the University of Auckland. We will engage students, educators and patients in theexperimental studies, following co-design and design-based research methodology.

Integrating education for sustainable development into a sustainable-smart transdisciplinary learning framework

Education for Sustainable Development (ESD) has been gaining traction as a promising approach for addressing social challenges and driving positive change within society. The purpose of this article is to explore how ESD can be foregrounded to reframe and enrich an existing learning framework called the Interdisciplinary Collaborative Online Learning Framework (ICoL). The ICoL framework has been developed since 2020 using a Design-based Research methodology. Literature on ESD lacks exploration of practical implementation for interdisciplinary collaborative projects within communities. This article interrogates the question of how to integrate ESD within the ICoL learning framework. This study is explorative, and data are drawn from a review of the literature and student reflections. A qualitative, themed analysis of the data revealed a fifth learning design principle and a fourth structuring element towards a new learning framework, called the Sustainable-Smart Transdisciplinary Learning Framework.

Designing Lexicogrammar Microlearning-Based Materials Infused With Listening Skills For 7th Graders

This study focused on the designing of English lexicogrammar materials that incorporate microlearning for junior high school students, especially 7th graders. The study aimed to develop effective instructional materials that enhance students' understanding of lexico-grammatical concepts through microlearning. A design-based research methodology was employed in this study in three phases (Richey & Klein, 2014b), namely analysis, design, and development. Information related to existing materials was gathered; the product model was planned; and the prototype design was then developed. Data was existing learning materials collected from teachers after they were interviewed and filled out a questionnaire. This study also utilized qualitative content analysis to examine a set of existing learning materials consisting of textbooks, PDFs, and ppt slides. The findings showed that the existing materials are not microlearning-based. The design of learning materials in lexicogrammar integrated with the listening skill named medium of microlearning objects was in the form of two podcasts, one audiobook, and some interactive games in integration with listening skill.

Increasing awareness and empathy among university students through immersive exercises - testing of the virtual reality application: A pilot study.

This paper presents an overview of a pilot study focused on testing the effectiveness of immersive virtual reality (VR) exercises, within extended reality experiences, in increasing awareness and empathy among university students towards pregnant women, elderly people, people in wheelchairs, and people with some sort of sight impairment. The extended reality experience was designed to simulate various scenarios that reflect the experiences of people from diverse backgrounds, to promote a better understanding of different perspectives and social issues related to some of the challenges tackled by people whose limitations are many times overlooked. A design-based research methodology was applied and qualitative and quantitative data were collected in samples of 20 students from 3 countries. Overall, the results suggest that immersive VR applications can be an effective tool in increasing awareness and empathy among higher education students. The use of VR technology can create a sense of presence and immersion that allows students to experience situations that they may not have encountered otherwise. The results attained with the immersive experiences have provided evidence that these solutions can foster a greater understanding of different perspectives and promote empathy towards individuals from diverse backgrounds. Ongoing research correlated with the Mixed Reality on Universal Design's Secret Service (Mr. UD) project results is already expanding on these findings by testing the effectiveness of VR applications in different contexts and with larger and more diverse samples. Additionally, the research conducted has provided relevant evidence that suggests that VR applications and their inclusion in training programs may help promote behavior change and reduce prejudice and discrimination towards marginalized groups. Med Pr. 2023;74(3):187-97.

Experiences of Parents of Pre-Adolescents Coping with Online Learning, Socialization and Navigating Critical Media Literacy

COVID-19 school closures necessitated shifts in how students engaged in learning and connected socially. For pre-adolescents and their families, these closures added urgency to an already identified challenge for parents trying to navigate their children’s engagement with digital platforms. Researchers utilized interviews to explore parent and child experiences related to online learning and behavior. Online workshops provided parents with critical media literacy (CML) knowledge and skills for navigating media texts and platforms. This paper employed emergent design-based research methodology and interpretive qualitative case-study methods. Data from interviews, recordings, and field notes were analyzed thematically. The analyses identified that parents noted increased time spent online by their children due to COVID-19 lockdowns. They also highlighted concerns for child safety, issues connected to CML, acknowledgment of the benefit of a support community amongst parents, and parent-child conversations about online actions. This study affirmed the need for parent support regarding CML and digital tools in educational and social online environments and provided suggestions for ways to promote this type of support.

A case of design based research methodology to create curriculum for an entrepreneurial thinking course.

In light of complex social, environmental and economic challenges, business schools play a critical role in preparing students to become future leaders. Society will need responsible and ethical leaders who will address these challenges, think entrepreneurially, and find ways to create viable solutions in for-profit, social enterprise and not-for-profit organizations. After extensive consultation with students, employers, and community partners, the researchers recognized that entrepreneurial skills are essential in business, regardless of career path or entrepreneurial self-identity. Using design-based research methodology, a unique course on entrepreneurial thinking was developed and launched by a large Canadian university in 2014. The course is unique in three ways: it is a required course for all Bachelor of Commerce Students (rather than elective); it is entirely focused on skill development (rather than entrepreneurial identity or efficacy); and it is large scale, with over 800 students per year enrolled in the class. This paper demonstrates over seven years of curriculum creation and iteration using design-based research. The learning and results of this work are presented through a theoretical lens of a deviant case study. The paper examines the unique combination of pedagogical approaches that have been utilized in the class and demonstrates the large-scale impact from more than 6000 students completing this course to-date. The researchers have developed a curriculum, based on Kolb's experiential learning theory, which delivers entrepreneurial thinking skills to non-nascent entrepreneurs at scale. The skill development that takes place in the course has been validated by multiple stakeholder groups including students, faculty, community, and employers. The paper aims to share the findings with the community.

Digital Workplace Skills: Designing the Integrated Learning of Accounting and Microsoft Excel

The ubiquitous use of Microsoft Excel among accountants has resulted in calls for students to become capable in its use to enhance their success when entering the accountancy profession. The objective of this paper is to investigate if, and how, an integrated learning approach can be designed to develop accounting students’ Microsoft Excel skills as part of their learning experience within first-year financial accounting modules. The study deployed a design-based research (DBR) methodology, an emerging approach in accounting education. The study involved 68 first-year accounting undergraduates in the participatory design of a blended learning intervention across three design iterations, including integrated learning of financial accounting and Microsoft Excel. The results demonstrate that perceived Microsoft Excel skill levels among participants improved as a result of the intervention, coupled with an expression of high confidence levels in use of the software. The students valued the authentic learning experience obtained and felt it would benefit them in future employment. The research findings provide guidance to accounting educators wishing to augment their students’ understanding with digital workplace skills and competency.

Comparative Analysis of Educational Approaches: Unveiling Strengths across Attributes

Design plays a pivotal role in the successful development of any interactive learning environment (ILE). Furthermore, in the realm of technology-enhanced learning (TEL), the design process necessitates contributions from a wide array of expertise areas. Therefore, individuals engaged in tool development must directly confront the design challenge from multiple standpoints. This article aims to present a comprehensive analysis of current research that centers on the utilization of various approaches as a means of enhancing technology-driven learning environments. The objective is to investigate how much of its instructional promise is genuinely put into practical implementation. The review exclusively considers empirical studies that have been published in peer-reviewed scholarly journals, focusing specifically on the application of diverse approaches as educational environments. Over the past ten years, the methodology of design-based research has proven its potential in both the research and design aspects of technology-enhanced learning environments (TELEs). This article delineates and characterizes design-based research, outlining its significance in the development of technology-enhanced learning environments (TELEs). It also introduces principles for the integration of design-based research into TELEs, and deliberates on the forthcoming challenges associated with this approach. The introduction of technology-enhanced learning (TEL) techniques has transformed the allocation of the most crucial resource in the education system: the time of educators and learners. Although new technology holds the promise of increased personalization and efficiency, the impact on staff time must be meticulously analyzed. Without careful consideration, TEL methods might escalate expenses without proportionate advantages. The paper evaluates various methods of comparing teaching time costs between TEL and traditional approaches. The conclusion suggests that cost-benefit modeling conducted within the institution provides the most accurate means of comprehending how educators can leverage technology to attain the level of efficiency that renders personalization economically viable. Options explored include Interactive Online Courses, Virtual Reality Classrooms, Gamified Learning Platforms, Personalized Learning AI, and Collaborative Social Learning. Assessment criteria encompass Learning Effectiveness, Engagement, Adaptability, Skill Transfer, Cost, Accessibility, User Experience, and Data Privacy. The examination serves as a foundation for establishing prerequisites tailored to a forward-looking cost-benefit framework. The process commences with strategic decisions aimed at realizing the advantages of Technology-Enhanced Learning (TEL). These decisions, in turn, inform the identification of probable essential expenditures, thus delineating the inherent "benefits-oriented cost model." A key benefit of this approach is that it empowers innovators to strategically plan and comprehend the dynamic between anticipated educational gains and potential teaching expenses.

Changes in Lesson Plans as Teachers Participate in a Professional Development on Statistical Literacy

Research on mathematics teacher knowledge has gained momentum recently; however, research on teacher planning is scarce, especially using lesson plans as the primary data source. This study examines how teachers' lesson plans change as they participate in a professional development, supporting them in implementing the Vietnamese reformed Curriculum 2018. Using a design-based research methodology, we developed a research-informed framework that assesses teachers' lesson plans for developing students' statistical literacy as emphasized in the mathematics Curriculum. Informed by research literature and data collected from teachers, the framework including seven criteria was shared and used by 61 teachers to reflect on the quality of their lessons. The analysis of 38 lesson plans shows all criteria have improved from pre- to post-lesson plans. The teachers included more explicit and comprehensive learning intentions in their post-lessons. Tasks in the post-lesson plans afforded more opportunities for students to develop statistical literacy, helped them engage in the statistical investigation using real data, and included multiple representations. Finally, the post-lesson plans tended to follow the constructivist teaching principles. Implications on ways to develop teachers' planning competence and suggestions for future studies are included.

Design-based research for the development of augmented reality applications: the case of virtual playground

Augmented Reality applications for education change the classroom experience for both teachers and students. However, the use of these tools is not widespread yet. Current applications still have some limitations, such as: hard to use interfaces, lack of freedom to create content, lack of support for a shared experience among others. This work presents the update of Virtual Playground, an application collaboratively created with language teachers, designers and engineers; and Virtual Playground Creator, an authorship tool for this application. This process was developed following Design-based research methodology in two cycles of ideation, implementation and testing. We present the updates and results regarding the second round of six tests of Virtual Playground with teachers. The main goals were to evaluate if Virtual Playground Creator allows teachers to create AR experiences to use in classrooms; and (2) investigate if there were missing or unnecessary features in Virtual Playground Creator. Results have shown that the tool allowed teachers to work with diverse skills and competences. The Virtual Playground Creator prototype allowed the teacher to create their AR experiences proposed, although, in some cases modifications were needed. The main issues were related to the limited 3D library in the prototype evaluated and lack of creation possibilities.

Challenging Traditional Teacher Professional Development by Implementing Technology-Supported Cooperative Learning

The goal of this study is to offer guidelines for the application of technology-supported cooperative learning professional development to enhance teachers’ self-directed learning skills. A qualitative approach was used which was informed by the interpretive paradigm. Many technology-supported cooperative learning professional development prototypes were created as part of the iterative design-based research methodology used in this study. Seven primary school Mathematics teachers from South African government schools participated in the technology-supported cooperative learning professional development for six weeks as part of a purposive sample. All the participants were scheduled for data collection through semi-structured interviews and follow-up interviews. The qualitative analysis computer data analysis system was used to prepare, process, and analyse the data collected from the semi-structured interviews. According to the findings of this research, teachers needed professional development that is affordable, flexible, intensive, and ongoing. The findings of the study provided insights into the best practices for implementing technology-supported cooperative learning professional development and enhancing teachers' self-directed skills. The study has the potential to contribute to the field of professional development for teachers as it will provide evidence-based recommendations for the effective and sustainable implementation of technology-supported cooperative learning professional development.

Effectiveness of a 3D simulation tool to teach the designing of metal removable partial dentures: A mixed-method study.

Acquiring insights into the framework design of metal-based removable partial dentures (mRPD) is a current challenge in dental education. The aim of the present study was to explore the effectiveness of a novel 3D simulation tool to teach designing mRPD by investigating the learning gain and the acceptance and motivation towards the tool of dental students. A 3D tool based on 74 clinical scenarios was developed for teaching the design of mRPD. Fifty-three third year dental students were randomly divided into two groups, with the experimental group (n = 26) having access to the tool during 1 week while the control group (n = 27) had no access. Quantitative analysis was based on a pre- and post-test in order to evaluate the learning gain, technology acceptance and motivation towards using the tool. Moreover, qualitative data was collected by means of an interview and focus group to get additional insights into the quantitative results. Although the results showed a higher learning gain for students in the experimental condition, the study did not find a significant difference between both conditions based on quantitative results. However, during the focus groups, all students of the experimental group revealed that the 3D tool improved their understanding of mRPD biomechanics. Moreover, survey results revealed that students positively evaluated the perceived usefulness and ease of use of the tool and indicated to have the intention to use the tool in the future. Suggestions were made for a redesign (e.g. creating scenarios themselves) and further implementation of the tool (e.g. analysing the scenarios in pairs or small groups). First results of the evaluation of the new 3D tool for teaching the design framework of mRPD are promising. Further research based on the design-based research methodology is needed to investigate the effects of the redesign on motivation and learning gain.