Group Dynamic Assessment Research Articles

The effect of digital game-based group dynamic assessment on L2 pragmatic competence

ABSTRACT This study explored EFL learners’ pragmatic competence and their perceptions following game-based group dynamic assessment (GDA). Sixty upper-intermediate learners were randomly assigned to experimental and control groups. All groups were instructed via a digital game called Trace Effects. The experimental groups participated in a cumulative GDA course by receiving mediation from the instructor, whereas the control group lacked synchronous feedback. In addition to identifying a typology of mediational moves for the experimental group using microgenetic analysis, ANCOVA was conducted to find possible differences between the control and experimental groups. The results showed that the experimental group improved their pragmalinguistic and sociopragmatic competencies, indicating their microgenetic development. Additionally, the experimental group’s attitudes on this experience were explored using follow-up interviews. Some themes emerged from the qualitative data analysis, including the perceived merits and demerits of the game-based GDA experience. The study’s findings may provide instructors and teacher educators with pedagogical insights. In particular, teacher education programs can provide instructors with the skills to incorporate game-based language learning, DA, and programs on implementing mediational moves in DA and GDA.

Relieving negative Chinese transfer in EFL syntactic writing through negative feedback based on computational thinking

Negative feedback can temporarily relieve negative Chinese transfer (NCT) in English as a foreign language (EFL) syntactic writing by focusing only on the surface writing constructs, neglecting that EFL writing is an embodiment of the process by which higher-order thinking operates. To solve the problem, the researchers conducted a pretest, interventionist group dynamic assessment (IGDA) in the form of negative feedback based on computational thinking (CT), higher-order thinking, and post-test quasi-experimental design, with a control group receiving the direct correction feedback instructing model to mitigate the NCT in EFL syntactic writing. We analyzed the syntactic writing types and frequencies of the NCT obtained through repeated-measure ANOVA and confirmed by qualitative data through video recording. The results indicated that IGDA in the form of negative feedback based on CT principal skills could (1) significantly decrease syntactic writing errors caused by the NCT, (2) improve learners’ EFL writing performance, and finally, (3) elevate the computer as an essential mediation tool. This innovative instructing mode of intervening with writing constructs and higher-order thinking and bringing about deeper thinking and creativity contributes to the EFL writing teaching methodology in a foreign language higher education.

Dynamic versus static assessment: effects on Iraqi EFL learners’ resilience, burnout, positive orientation, and academic success

Assessment plays a vital role in English language learning as it helps students recognize their weak and strong points. Two main types of assessment are dynamic assessment (DA) and static assessment (SA) that their effects have not been examined on Iraqi EFL students’ resilience, burnout, positive orientation (PO), and language academic achievement yet. Therefore, this research aims to close this gap. To do so, sixty intermediate EFL students were selected and divided into DA and SA groups to do so. The two groups were then given pretests on the four dependent variables. Subsequently, one group was taught ten reading literary texts with 100 new words using DA, whereas the other group was taught identical materials using SA. After the 8-week course, both groups took the post-tests on resilience, burnout, PO, and academic performance. The study’s findings showed that the DA group did better than the SA group on the four post-tests. It can be concluded that using DA with the support of literary texts can produce positive effects in EFL classes. The current study has consequences for researchers, students, English instructors, and other stakeholders.

Implementing dynamic assessment in writing in Chinese as a second language: Towards an adjusted cumulative group dynamic assessment

Drawing on Vygotskian sociocultural theory and adopting a microgenetic analysis method, this study examined the effectiveness of group dynamic assessment (G-DA) on Chinese as a second language (CSL) learners' writing, intending to propose an adjusted cumulative G-DA. A five-week study was conducted in two parallel writing classrooms, where G-DA was used in the experimental class to assess and mediate the learners' writing. The study found that the G-DA and non-G-DA students' writing performance did not show a significant difference in the static assessments; however, the effectiveness of the G-DA was examined through the reduction in the amount of mediation and the changes in the mediation types in the G-DA group, which demonstrated that the G-DA of CSL writing had a positive effect on the learners' internalization of linguistic knowledge. This paper reports the microgenetic analysis focusing on two G-DA students to provide an in-depth account of the G-DA. Learners' internalization was more salient regarding their grammatical knowledge than vocabulary and Chinese character knowledge. Meanwhile, mediated feedback was more conducive to developing writing in the lower-proficiency CSL learner. To illustrate the potential affordances that G-DA can offer to CSL writing classrooms, this study also proposes and discusses an adjusted cumulative G-DA in the context of CSL writing.

Promoting interaction and lowering speaking anxiety in an EMI course: a group dynamic assessment approach

Abstract This study first examined the effectiveness of applying the Group Dynamic Assessment (G-DA) approach to assessing the oral skills of non-native English-speaking university students who are provided with mediation by their teacher in a small group setting. Second, it aimed to understand whether employing innovative G-DA techniques could reduce the speaking anxiety felt by university students if they received support from either their teacher or their peers during assessment. Fifty freshmen’ speaking performance on TOEFL integrated speaking tasks, and their responses to the teacher’s mediation in groups were compared. Results showed that (1) the G-DA approach could be a beneficial tool for assessing English oral proficiency in the EMI context, and (2) the procedures involved in G-DA helped university students feel less anxiety when prompted to respond orally. It provides insights into an alternative approach to assessment which can be employed to group learning in the context of EMI courses.

Visual Analysis of Dynamic Assessment Research Based on CiteSpace (1990–2022)

Abstract This study uses CiteSpace to map the scientometric analysis of dynamic assessment (DA) research in the Web of Science core collection from 1990 to 2022 in the areas of psychology, education and language learning. Firstly, the study found that DA was initially employed in the fields of psychology and special education, and has been gaining attention from second language acquisition researchers in recent years. And Vygotsky, the representative figure of sociolcultural theory, has the highest influence, and Budoff has the greatest degree as a bridge. Secondly, five research topics are found through keyword clustering, which are early identification, group dynamic assessment, short-term progress monitoring, computerized dynamic assessment and teacher education. At the same time, the analysis of burst reference shows that the computerized dynamic assessment will be the trend in the future, and dynamic assessment of second language tends to use mixed research method. Through a review of previous studies, this paper explores the paradigms and methods of empirical research in DA, hoping to provide new alternatives for future research.

Unpacking Chinese lower-proficiency EFL learners’ conceptual development of English subjunctives with group dynamic assessment: Efficacy, sustainability and reciprocity

Vygotsky’s distinctive pedagogy, dynamic assessment (DA), has been validated by numerous studies that examine the one-on-one interactions between learners and mediators. However, the literature on group dynamic assessment (G-DA) is scarce, particularly in terms of comparative studies involving L2 learners with different proficiency levels. Among these learners, lower-proficiency Chinese EFL learners have been largely neglected. Additionally, G-DA’s sustainability and reciprocity have been ignored. To fill these gaps, we examined G-DA’s effect on Chinese learners’ conceptual development in English subjunctives. An experiment was conducted at a Chinese university in a northeastern city with 59 Chinese EFL students divided into three groups: a lower-level experimental class (LEC = 20), a lower-level control class (LCC = 20), and a higher-level experimental class (HEC = 19). LCC received traditional instruction, while LEC and HEC used G-DA. The data collection spanned eight weeks, including the following sources: teacher-mediated scaffolding, learner responses, pre-test, post-test, and delayed test scores, and a transfer task that assessed learners’ conceptual development of English subjunctives. The results showed that G-DA significantly and sustainably affected the conceptual development of English subjunctives for both LEC and HEC, compared to LCC. Moreover, the study identified eleven mediational and nine reciprocal interactions that revealed the learners’ conceptual changes. This study also found that HEC learners demonstrated more transfer of the target knowledge. Finally, the study concluded with some implications for EFL teachers.

On the impact of online interactionist vs. interventionist dynamic assessment on Iranian EFL learners’ writing performance

This paper reports the results of a study aiming to investigate the effects of interactionist and interventionist dynamic assessment (DA) on learners’ writing performance. To do so, 63 upper-intermediate EFL learners were selected as the study participants. A writing pretest was administered to ensure the homogeneity of the participants and determine their level of proficiency prior to treatment. In the online interactionist DA group, the researchers implemented the treatment based on the ‘Dynamic Mediation Process’ proposed by Elliott (2002) and Xiaoxiao and Yan (2010). The framework comprised topic-choice, idea-generation, structuring and macro-revising stages. In doing so, the pre-task phase was conducted, followed by providing the mediation and performing post-task. In the interventionist DA group, Lantolf and Poehner’s (2011) framework was followed. Based on this framework, the learners’ erroneous language chunks were treated through the teacher’s underlining the error, putting a question mark, circling it, or posing a written question concerning the problematic part. Alternatively, the teacher would point out the incorrect part and offer two options for the learners to choose from. At the end, a writing posttest was given to all groups to evaluate their writing performance after treatment. As the study findings helped reveal, both interactionist and interventionist DA types improved learners’ writing performance. In addition, the comparison of the posttest scores indicated that the interactionist DA group participants even outperformed the interventionist ones on the writing posttest. The implications of the findings are discussed throughout the paper.

Group dynamic assessment vs. computerized dynamic assessment: impacts on L2 listening development, L2 students’ perfectionism, foreign language anxiety, and intrinsic motivation

Dynamic assessment is heavily based on Vygotskian socio-cultural theory and in recent years researchers have shown interest in the theory as a way to facilitate learning. This study attempted to examine the comparative effect of group dynamic assessment (GDA) and computerized dynamic assessment (CDA) on listening development, L2 learners’ perfectionism, anxiety, and intrinsic motivation. To this end, 91 intermediate learners of English were selected based on convenience sampling and were divided into 3 groups: a GDA, a CDA, and a control group (CG). After implementing the treatment, the tests conducted and the data gathered. The results of one-way ANOVA showed that both GDA and CDA were facilitative of listening development with a large effect size (effect size = .516), and the difference between them was nonsignificant (p > 0.05). The results further showed that both GDA and CDA could ameliorate perfectionism with a moderate effect size (effect size = .332), decrease anxiety with a small effect size (.218), and increase intrinsic motivation among L2 learners with a small effect size (effect size = .228). The findings can have implications for language practitioners, and materials developers. The implications of the study are discussed.

Effects of concurrent and cumulative group dynamic assessments on EFL learners’ development of reading comprehension micro-skills

The current study set out to investigate the effects of concurrent group dynamic assessment (GDA) and cumulative GDA on Iranian EFL learners’ development of reading comprehension micro-skills. To this end, a convenience sample of 60 intermediate undergraduate EFL university students that were selected based on the results of a placement test and randomly assigned to two experimental groups participated in the study. The participants met once a week for 90-min lessons in a Reading II class over an academic semester. Each group received a concurrent or cumulative GDA mediation on reading tasks with a focus on activities involving five fundamental reading comprehension micro-skills, namely identifying the main idea, finding inferences, finding supporting details, understanding vocabulary, and finding references. A pretest/posttest procedure was used to compare the two group’s achievements. The results of t test analyses demonstrated that both GDA approaches were effective but the students in the concurrent GDA group significantly outperformed those in the cumulative GDA group in terms of micro-skills of identifying the main idea and finding inferences whereas no significant differences were observed for other micro-skills. It could be argued that in concurrent GDA since the secondary interactants expect to be called on at any moment, they are more alert and attentive to mediational exchanges, and this contributes to enriching the micro-skills of identifying the main idea and finding inferences. The findings suggest that concurrent and cumulative GDA approaches when applied to teaching reading comprehension should be viewed as complementary. The concurrent approach works better with activities that require higher-cognitive functions and top-down processes such as identifying main ideas or finding inferences. On the other hand, both approaches could be equally beneficial and interchangeably used in activities that involve lower-level bottom-up cognitive processes such as finding supporting details, understanding vocabulary, or finding references. The findings offer significant implications for classroom practice and subsequent research that are discussed.

The Use of Dynamic Assessment for Group Learners in the Language Classroom: A Literature Review

The paper reviews the research on the use of Dynamic Assessment (DA) in the language classroom instruction for group learners. DA assesses learners’ abilities in a comprehensive scope of Zone of Proximal Development (ZPD) from one continuum of actual independent performance to the other continuum of potential performance with external support, and DA also sees the external support offered as a driving force of advancing learners’ development within ZPD. With its unique view, DA sheds the new light to the ESL and EFL language teaching and learning, and most DA studies focus on its effectiveness in promoting the development of EFL and ESL learners’ language skills. However, most studies adopt DA in a one-on-one teacher-student model and address DA’s interplay with individuals’ ZPD, which discourages the implementation of DA in the language classrooms with group learners. This paper reviews the existing research on how DA mediates group learners in the language classroom. The review indicates that among the limited research, most studies follow from Group Dynamic Assessment (GDA) and few studies propose alternative DA approaches. All the studies reviewed confirm DA’s effectiveness of promoting group learners’ learning. However, given the dearth of research, it is insufficient to conclude on DA’s mediation of group learners in the language classroom, and more studies are needed.

The comparative effects of consciousness raising tasks and dynamic assessment on morphological awareness: the case of pre-intermediate EFL learners

Finding out which teaching strategies best support students learning is a key objective of educational research. Knowing this, this study investigated the comparative effects of consciousness-raising (CR) tasks and dynamic assessment (DA) on morphological awareness in an Afghani EFL context. To achieve this, 90 EFL grade 11 learners from three intact classes were selected through a convenience sampling procedure and were assigned to DA, CR, and control groups, respectively, with the same number of participants in each condition. A nonrandomized pretest–posttest design was carried out. The results of the Oxford quick placement test revealed that the participants had pre-intermediate English proficiency. To assess learners’ morphological awareness, two different tests of morphological awareness were given both prior to the treatment and right after it. The DA group received interactionist DA on the target morphemes, the CR group received CR instruction on the target form, and the control group received nothing. The results of a one-way between-groups ANOVA revealed that both DA and CR groups significantly outperformed the control group on the post-test. A further post hoc analysis using Bonferroni adjustment demonstrated that the difference between DA and CR groups was also statistically significant with a small effect size (eta squared = 0.042), substantiating the superiority of DA over CR tasks on morphological awareness. The theoretical and pedagogical implications of the study are discussed.

Cultivating EFL learners’ productive skills by employing dynamic and non-dynamic assessments: attitude in focus

In this study, the potential impacts of dynamic assessment (DA) and non-dynamic assessment (non-DA) on Ethiopian EFL students’ productive skills were investigated. Additionally, this study examined Ethiopian EFL students’ attitudes regarding using DA in their speaking and writing classes. Fifty-three Ethiopian intermediate EFL learners were selected using the convenience sampling method and separated into two groups in order to accomplish these goals. Next, both groups were pretested on two skills of writing and speaking. Then, one group received speaking and writing instruction utilizing DA, whereas the other group received instruction using non-DA. After 16 sessions of training, the groups received writing and speaking posttests, and the DA group also received an attitude questionnaire. The results indicated that there was a significant difference between the speaking and writing posttests of both groups in favor of the experimental group. In fact, the study’s findings revealed that the DA group outstripped the non-DA group on the speaking and writing posttests. The outcomes also indicated that the participants of the DA group held positive attitudes toward the AD. It was concluded that using the DA in EFL classes is an effective method for advancing EFL students’ English language acquisition. The implications of this research can persuade teachers to apply DA in their teaching process.

Cultivating interlanguage pragmatic comprehension through concurrent and cumulative group dynamic assessment: a mixed-methods study

This study explored the effects of concurrent group dynamic assessment (G-DA) and cumulative G-DA on Iranian pre-intermediate English as a foreign language (EFL) learners’ interlanguage pragmatic comprehension (ILPC). To this end, a total of 97 pre-intermediate learners took the key English test (KET) test and 45 learners whose scores fell between − 1 and + 1 SD were selected and randomly assigned to experimental groups, namely concurrent G-DA (n = 15), cumulative G-DA (n = 15), and a control group, namely immediate feedback (IF) group (n = 15). Then, they went through pre-test, interventions (lasting fifteen 1-h sessions held three times a week), and post-test procedures, as well as the interactions among the teachers and learners were recorded. The data were analyzed through a one-way analysis of covariance (ANCOVA) and a microgenetic development approach. Results revealed that the concurrent G-DA and cumulative G-DA outperformed the IP group concerning the gains in the ILPC on the post-test. Additionally, the complementary microgenetic findings demonstrated the ways through which the concurrent G-DA and cumulative G-DA could lead to improving the learners’ ILPC.

Effects of Group-Dynamic Assessment and Process-Based Instruction on EFL Learners' Metacognitive Awareness and Listening Comprehension: A Mixed-Methods Inquiry.

Although a range of studies has explored the effectiveness of group-dynamic assessment (G-DA) and process-based instruction (PBI) in second language (L2) learning, no study has compared the effects of G-DA and PBI on EFL learners' metacognitive awareness (MA) and listening comprehension (LC). Thus, this study aimed to explore the effects of G-DA and PBI on fostering EFL learners' metacognitive awareness (MA) and listening comprehension (LC) in Iran. For this purpose, a total of one hundred and sixty intermediate EFL learners were selected through a convenience sampling method at Iran Language Institute (ILI) and were homogenized using the Key English Test (KET). The EFL learners whose scores fell around the mean score were chosen and randomly allocated as G-DA group (n = 30), PBI group (n = 30), and control group (n = 30). Afterward, they went through a pre-test, interventions (lasting 16 one-hour sessions held twice a week) and a post-test. The interactions in the classes were also meticulously recorded. The collected data were analyzed using a one-way ANOVA and a microgenetic development approach. Findings evidenced that the G-DA group and PBI group outperformed the control group concerning the gains in MA and LC. However, the findings evidenced that G-DA was more effective than PBI to foster the EFL learners' MA and LC. Additionally, the complementary qualitative results documented that the proper feedback offered in line with the principles and procedures of G-DA and PBI contributed to developing the participants' MA and LC. The study ends by offering some implications for the relevant stakeholders.

Scaffolding via Group-dynamic Assessment to Positively Affect Motivation, Learning Anxiety, and Willingness to Communicate: A Case Study of High School Students.

Although a mass of studies has demonstrated the effectiveness of scaffolding through group-dynamic assessment (G-DA) in fostering English as a foreign language (EFL) learners' language skills and components, its contributions to developing psychological constructs, such as motivation, learning anxiety (LA), and willingness to communicate (WTC) have remained largely unexplored in the context of Iranian high schools. Thus, this study purported to disclose the contributions of G-DA to Iranian high school students' motivation, LA, and WTC. For these purposes, 124 grade 11 students were chosen through a random sampling method at Shahed High School in Borujerd City, Iran, homogenized through the Oxford Quick Placement test (OQPT), and randomly allocated as a control group (CG) (n = 23) and an experimental group (EG) (n = 23). Afterward, a pre-test, interventions (for 16 one-hour sessions held two times a week as an extra-curricular program), and a post-test were implemented. The results of the independent samples t-tests evidenced that EG's motivation significantly improved compared to CG after the interventions. Additionally, the findings revealed that the G-DA-based instruction significantly contributed to relieving EG's LA. Further, the results uncovered that a statistically significant difference existed between EG and CG concerning the gains in WTC. The findings gained in this study are anticipated to contribute significantly to the various EFL settings, as well as they offer a variety of recommendations and implications for relevant stakeholders.

An Interventionist Dynamic Assessment Approach to College English Writing in China

ABSTRACT This article explores the value of dynamic assessment (DA) for college English writing (CEW), a required course for millions of students in China that typically enrolls 50 students in each class. An interventionist approach to DA, in which mediation and administration are standardized, was selected and supplemented with a construct-descriptor-based rating checklist as a writing assessment before and after an eight-week instruction phase. The DA group received graduated mediation that focused on the constructs and descriptors from the scale, while a control group received holistic corrections. Data were processed through ANOVA and MANCOVA revealing variable development concerning specific constructs but overall significantly greater improvement by the DA group. The results are interpreted according to the degree of change as indicative of the zone of proximal development. The value of the construct-driven scale and associated descriptors through the mediational process are also discussed. It is argued that interventionist DA is equipped to identify the components and processes within a construct, and in so doing offers the possibility of fine-tuning teachers’ and learners’ understanding of problem areas for individuals.

Effects of Group Dynamic Assessment on L2 Chinese learners’ literacy development: Learners’ responsiveness to interactive mediation

Abstract Dynamic Assessment (DA), an innovative assessment approach, has begun to attract attention as a conceptualization of assessment that emphasizes the social interactive role of learning. Although DA receives attention in the field of language testing/assessment, its feasibility in engaging larger cohorts of individuals is concerned. This shortcoming of DA leads to the application of Group Dynamic Assessment (G-DA). This study examined the extent to which mediation provided through G-DA frameworks – concurrent and cumulative – supported a group of language learners’ literacy development. It investigates five intermediate L2 Chinese learners’ rhetorical awareness via their performance on Chinese reading and writing tasks. One Chinese rhetorical structures, the ‘Qi-cheng-zhuan-he’ approach, was selected because it is considered the most difficult learning point for Chinese learners. Findings were reported: 1) the mediation provided to the participants through both concurrent and cumulative G-DA approaches promoted their understanding of the ‘Qi-cheng-zhuan-he’ approach, 2) the more times a participant engaged as the primary interactant, the better learning outcome he/she would present, 3) individual participant had different developmental level and thus showed various extent of responsiveness to the teacher’s mediation; yet, their active participation, either verbal or nonverbal behaviors, would foster their learning performance. Pedagogical applications are discussed.

Dynamic vs. diagnostic assessment: impacts on EFL learners’ speaking fluency and accuracy, learning anxiety, and cognitive load

Despite their importance, dynamic and diagnostic assessments (DigAs) have received little attention in phycological aspects of foreign language teaching and learning settings; therefore, this study compared the effects of dynamic and diagnostic assessment (DigA) on Afghan EFL learners’ speaking fluency and accuracy (SFA), learning anxiety (LA), and cognitive load (CL). To do so, 90 Afghan EFL learners were recruited and assigned to two experimental groups (EGs), namely a dynamic assessment group (DAG), a DigAG, and a control group (CG). After that, the three groups were pretested on SFA, LA, and CL. Then, one EG was trained based on the DA, and the other EG was taught based on the DigA, while the CG received common speaking instruction. After finishing the instruction, all groups were given the posttests of SFA, LA, and CL to evaluate the impacts of the treatment on their performances. The findings of the one-way ANOVA test divulged that both EGs outflanked the CG on their posttests. In fact, using dynamic and DigA developed EFL learners’ SFA and CL and reduced their LA. Though both EGs outflanked the CG, the DAG had better improvement than the DigAG on their posttests. At the end of the research, some implications were provided, and some suggestions were recommended for the next studies.

Teacher as creator: Orchestrating the learning environment to promote learner development

Sociocultural theory (SCT) is a powerful basis for exploring and guiding L2 (second/foreign language) learner development. For the most part, however, the focus of classroom SCT-L2 has been on single activities, for example, teacher mediation of learners’ writing process or peer scaffolding. In this paper, we expand on these studies, building on Vygotsky’s (1997) metaphor of teacher as a creator of learner development. We propose how activities (1) where agency for guiding development lies with learners, (2) where the teacher takes the lead in guiding learner development, and (3) where opportunities for development emerge in dialogical interaction between the teacher and learners can be orchestrated to collectively create learner development. We report on an academic L2 English writing course at a Japanese university. The instructor first created opportunities for learner development in peer interactions. The instructor then built on the information received from these with regard to learners’ challenge with coherence in subsequent group dynamic assessment and frontal work using a SCOBA. Finally, the instructor traced the change in learners’ self-regulation in later peer interactions. We will focus on the development of one learner’s L2 English writing throughout the course, illustrating how insights into areas of learners’ struggle and mediated performance emerged in peer interaction, how the instructor built on these, and how this mediation guided the peer interaction to follow.