Framework For Formative Assessment Research Articles

Employing multimodal dialogic feedback on EFL tertiary students’ writing: Formative assessment framework

Feedback is essential for improving EFL students' writing skills, even though it is still underutilized. Yet, only some studies examine multimodal dialogic feedback (MDF) on students' writing. To address the gap, this study, which employed an exploratory mixed-method, investigated the impact of MDF mediated by utilizing Google Docs and Zoom conferences as convenience platforms in a writing class among some Indonesian university learners and the impact of this MDF on the revision quality of the student texts. Furthermore, the study explored the students' perceptions of MDF from the formative assessment framework. While the quantitative method through classroom action research (CAR) with 39 students recruited purposively, examined the impact of MDF on students' writing skills, the qualitative approach using semi-structured in-person interviews with eleven students recruited conveniently, addressed the student's perceptions of the influence of MDF on their writing skills. The quantitative data were analyzed through simple descriptive statistical analyses to visualize the trend of students' improvement and the instructor's feedback. The qualitative data on the students' positive perceptions of the impact of MDF on their writing were analyzed using thematic analysis. Statistical analyses of the student's texts reveal that the student's writing skills are gradually developing. The results demonstrate how mediating MDF during teaching-learning writing affected the student's work on organization, content, language use, mechanics, and text length. Implications for writing instruction and the instructor's feedback are also discussed. Although this current study has limitations, suggestions for further research are offered.

Evaluating ChatGPT-Generated Linear Algebra Formative Assessments

This research explored Large Language Models potential uses on formative assessment for mathematical problem-solving process. The study provides a conceptual analysis of feedback and how the use of these models is related in the context of formative assessment for Linear Algebra problems. Particularly, the performance of a popular model known as ChatGPT in mathematical problems fails on reasoning, proofs, model construction, among others. Formative assessment is a process used by teachers and students during instruction that provides feedback to adjust ongoing teaching and learning to improve student’s achievement of intended instructional outcomes. The study analyzed and evaluated feedback provided to engineering students in their solutions, from both, instructors and ChatGPT, against fine-grained criteria of a formative feedback model that includes affective aspects. Considering preliminary outputs, and to improve performance of feedback from both agents’ instructors and ChatGPT, we developed a framework for formative assessment in mathematical problemsolving using a Large Language Model (LLM). We designed a framework to generate prompts, supported by common Linear Algebra mistakes within the context of concept development and problem-solving strategies. In this framework, the instructor acts as an agent to verify tasks in a math problem assigned to students, establishing a virtuous cycle of learning of queries supported by ChatGPT. Results revealed potentialities and challenges on how to improve feedback on graduate-level math problems, by which both educators and students adapt teaching and learning strategies.

A whole learning process-oriented formative assessment framework to cultivate complex skills

In the 21st century, cultivating complex skills has become an urgent educational need, especially in vocational training and learning. The widespread lack of formative assessment during complex problem-solving and skill-learning processes limits students’ self-perception of their weakness and teachers’ effective monitoring of students’ mastery of complex skills in class. To investigate methods of how to design and carry out formative assessments for the learning of complex skills, a whole learning process-oriented formative assessment framework for complex skills was established. To verify the feasibility and effects of the formative assessment, a controlled experiment involving 35 students majoring in industrial robotics from one of Shanghai’s Technical Institutes was designed. The results indicate that the formative assessment can effectively promote students’ learning of conceptual knowledge and the construction and automation of cognitive schema as well as improve students’ competency in the implementation and transference of complex skills. In addition, the formative assessment, which can optimize the allocation of psychological effort by increasing the proportion of germane cognitive load within the overall cognitive load, does not place an additional cognitive load on students. It can provide methodological support for promoting students’ learning of complex skills.

Formative assessment strategies for students' conceptions—The potential of learning analytics

AbstractFormative assessment is considered to be helpful in students' learning support and teaching design. Following Aufschnaiter's and Alonzo's framework, formative assessment practices of teachers can be subdivided into three practices: eliciting evidence, interpreting evidence and responding. Since students' conceptions are judged to be important for meaningful learning across disciplines, teachers are required to assess their students' conceptions. The focus of this article lies on the discussion of learning analytics for supporting the assessment of students' conceptions in class. The existing and potential contributions of learning analytics are discussed related to the named formative assessment framework in order to enhance the teachers' options to consider individual students' conceptions. We refer to findings from biology and computer science education on existing assessment tools and identify limitations and potentials with respect to the assessment of students' conceptions. Practitioner notesWhat is already known about this topic Students' conceptions are considered to be important for learning processes, but interpreting evidence for learning with respect to students' conceptions is challenging for teachers. Assessment tools have been developed in different educational domains for teaching practice. Techniques from artificial intelligence and machine learning have been applied for automated assessment of specific aspects of learning. What does the paper add Findings on existing assessment tools from two educational domains are summarised and limitations with respect to assessment of students' conceptions are identified. Relevent data that needs to be analysed for insights into students' conceptions is identified from an educational perspective. Potential contributions of learning analytics to support the challenging task to elicit students' conceptions are discussed. Implications for practice and/or policy Learning analytics can enhance the eliciting of students' conceptions. Based on the analysis of existing works, further exploration and developments of analysis techniques for unstructured text and multimodal data are desirable to support the eliciting of students' conceptions.

Reshaping the EFL Formative Assessment Pedagogy With Blockchain Technology

Blockchain technology is a distributed database with features such as no forgery, full traceability, openness, and transparency which is superior in establishing trust mechanisms and brings new opportunities for finance, healthcare, technology, and education. As a required course of all universities in China, College English has a large demographic covering millions of students. But the traditional EFL summative assessment model fails to fully reflect the L2 learner’s learning process and increment performance. The current paper focuses on the novel applications of blockchain in the educational domain and how blockchain technology reshapes the EFL Formative Assessment framework in the consensus mechanism to achieve a decentralized and highly trusted learning process record and evaluation. This innovative approach aims at improving the openness, transparency, and fairness of the EFL learning process by recording and monitoring the teachers’ and students’ behaviors. The research findings of this paper provide preliminary exploration for L2 evaluation and supply some inspiration to policymakers, EFL practitioners, and technology developers about the potential usages of digital credentials anchored on blockchains.

Towards an Antiracist Classroom Formative Assessment Framework

ABSTRACT The purpose of this paper is to theoretically explore how Hip Hop pedagogy can be utilized and implemented in K-12 classroom formative assessment practices. As a conceptual paper, there will be five sections. The first section will explore classroom formative assessment definitions and highlight theoretical frameworks used to conceptualize the pedagogical practice. The next section will begin to formulate aspects of an antiracist classroom formative assessment theoretical framework. The third section will explore how Hip Hop pedagogy can be used as an antiracist classroom formative assessment approach, while the fourth section will address considerations and objections related to such usage. The final section will end with a call to action for educational researchers, professionals, and practitioners who want to interrogate and investigate how to overcome systematic racism and oppression in our classroom assessment research and practice.

Design of Computerized Adaptive Testing Module into Our Dynamic Adaptive Hypermedia System

By the end of the 20th century, the most common and traditional paper and pencil tests (PBT) were faced with an increasing set of difficulties and drawbacks. Proceed and meet the measurement and evaluation needs of the 21st century; it is mandatory to have radical and qualitative changes. The accelerating pace of technological innovation in Education shows a clear path to computer-based testing, which offers a more engaging and innovative testing environment, as well as the ability to obtain instant results and feedback, the use of dynamic, multimedia learning objects (LO), and the implementation of adaptive, individualized assessment approaches. In this sense, this paper presents an adaptive formative assessment framework in which test adaptation is based on multiple criteria. The presented system bases its adaptation on the test takers' proficiency, schemata, desirable learning goal, cognitive level, and learning style. The main objective of this paper is to discuss the value of the adaptive testing system. Therefore, it presents the design and implementation of the system and the adaptive rules employed.

A Framework for Mobile-Assisted Formative Assessment to Promote Students’ Self-Determination

Motivation is an important issue to consider when designing learning activities, including mobile learning and assessment. While previous research provides evidence for the motivational impact of mobile learning, not many pedagogical frameworks exist for the design of mobile-assisted learning and assessment. The current study is grounded in the Self-Determination Theory of motivation and proposes a pedagogical framework for mobile-assisted formative assessment, aiming at enhancing student motivation. For a preliminary evaluation of the framework, fifty-one students from a public European high school participated in a series of formative assessment activities. The tasks that were implemented according to the proposed mobile-based formative assessment framework had a significant positive impact on student perceived levels of autonomy, competence, and relatedness, enhancing students’ intrinsic motivation levels. Study findings highlighted the capacity of the proposed framework to guide the design of mobile-based formative assessment activities that enhance and promote student motivation. The study makes a theoretical contribution by proposing a framework that aligns mobile learning and assessment with elements of the Self-Determination Theory of motivation and also has a practical contribution by implementing mobile learning and assessment practices that have the potential to promote student motivation.

Contextual Considerations: Revision of the Wiliam and Thompson (2007) Formative Assessment Framework in the Jamaican Context

The research context should be carefully considered in qualitative, quantitative, and mixed methods research as it influences the efficacy of the processes and outcomes. This paper describes how contextual factors in the teaching of English in Jamaican secondary schools led to changes in the Wiliam and Thompson (2007) formative assessment framework. Data collected through interviews and observations of 32 teachers of English in the qualitative phase of a mixed-methods study reinforced the conceptualization of formative assessment as a unified framework. However, they elucidated the manifestations of Jamaica’s colonial past and the language context in Jamaican classrooms that necessitated changes to a widely accepted framework. Changes were made to the sequencing of the five aspects to ensure a more effective implementation of the framework in the Jamaican context.

Why aren’t teachers using formative assessment? What can be done about it?

Formative assessment is a crucial aspect of teaching and learning in the classroom, but there is evidence that there has been a lack of effective implementation of formative assessment in practice. In response, this article outlines the design and development of a formative assessment framework that can be implemented as a consistent whole-school approach to embedding practice that is owned and developed by teachers. The approach outlined in the framework, therefore, is designed to integrate formative assessment practices within a school system context, providing advice and support to school leaders and teachers. The framework in practice should act to enable teachers and students to develop new understandings and perspectives about each other and the nature of teaching and learning, as well as ways to implement new practices of teaching and learning supported by reflective modes of active participation.

Effect of a formative assessment intervention on nursing skills laboratory learning in a resource-constrained country

BackgroundFollowing a global trend, nursing education institutions in Malawi adopted the skills laboratory approach for the teaching and learning of essential nursing skills in the bachelor degree in nursing. Students and faculty expressed concern about the lack of regular and planned formative assessments that build the competencies required in the middle and senior years of study. PurposeThe aim was to investigate the effect of a Formative Assessment Framework (FAF) on students learning in skills laboratories. MethodsA sequential, mixed methods design was chosen, starting with qualitative approach followed by a quantitative approach using a quasi-experimental design. Formative Assessment Framework (FAF) was developed after phase 1, validated and tested on the teaching of eight nursing procedures in phase 2. Quantitative data were collected from students (n = 160) for 6 weeks. Data were analysed using STATA software packages. ResultsSignificant mean differences occurred between the pretest and posttest mean scores for seven procedures with a p-value of <0.05. ConclusionThe use of a Formative Assessment Framework had a significant effect on clinical teaching and learning. The findings indicate that the FAF has the capacity to improve the students' clinical preparation for competencies in the OSCE, which takes place in the skills laboratories.

Adaptation and Examination of the Greek General Formative Assessment Framework P.D./152/2013 in Physical Education Teachers

Adaptation and Examination of the Greek General Formative Assessment Framework P.D./152/2013 in Physical Education Teachers

A Conceptual Qualitative Framework for Assessing Human Systems Engineering Education Outcomes and Opportunities

Human systems engineering education seeks to infuse principles of applied psychology, cognitive science, human factors, and user-centered design into the engineering curriculum to help students understand the people they are engineering for (e.g., clients) and their own roles as engineers. This paper outlines a conceptual qualitative framework for formative assessment of students’ incorporation of human systems engineering concepts in their projects and documentation. The framework examines potential conceptual dimensions along with applications, sources, and depth of such knowledge, which we argue can begin to evaluate students’ work and inform iterative efforts to improve human-centered engineering education programs. Example applications of the framework based on several data sets are discussed.

Formative assessment framework proposal for transversal competencies: Application to analysis and problem-solving competence

Purpose: In the last years, there is an increasing interest in the manner that transversal competences (TC) are introduced in the curricula. Transversal competences are generic and relevant skills that students have to develop through the several stages of the educational degrees. This paper analyses TCs in the context of the learning process of undergraduate and postgraduate courses. The main aim of this paper is to propose a framework to improve results. The framework facilities the student's training and one of the important pieces is undoubtedly that he has constant feedback from his assessments that allowing to improve the learning. An applying in the analysis and problem solving competence in the context of Master Degree in Advanced Engineering Production, Logistics and Supply Chain at the UPV is carried out.Design/methodology/approach: The work is the result of several years of professional experience in the application of the concept of transversal competence in the UPV with undergraduate and graduate students. As a result of this work and various educational innovation projects, a team of experts has been created, which has been discussing some aspects relevant to the improvement of the teaching-learning process. One of these areas of work has been in relation to the integration of various proposals on the application and deployment of transversal competences. With respect to this work, a conceptual proposal is proposed that has subsequently been empirically validated through the analysis of the results of several groups of students in a degree.Findings: The main result that is offered in the work is a framework that allows identifying the elements that are part of the learning process in the area of transversal competences. Likewise, the different items that are part of the framework are linked to the student's life cycle, and a temporal scope is established for their deployment.Practical implications: One of the most noteworthy practical implications is that the proposed framework includes a tool that allows a clear measurement of the student's evolution throughout his / her formative life cycle. In this way the student has a more consistent and robust vision of his / her training and the academic directors of the titles can have a vision of the impact of the decisions on the learning processes.Originality/value: The analysis of transversal competences is usually presented in the context of a subject. In this paper we propose an approach to cross-curricular competences but in the scope of the student's complete life cycle. The consideration of the entire formative process as well as the identification of the relevant elements that are part of this process are the most original aspects of the work.

Progressions of a New Language: Characterizing Explanation Development for Assessment With Young Language Learners

ABSTRACTFew studies have detailed the emergence and growth of the oral language and discourse characteristics of school-age students at different grades and across time (Bailey, 2010; Hoff, 2013). Yet general education teachers and English language specialists need well-articulated, preferably empirically derived progressions of language learning to support their students’ oral language development, particularly with those students who are acquiring English as a new or second language. Explanation skills, which encompass the development of many different language and discourse features, were the focus of this study. The language learners whose elicited oral explanations were used to characterize the order of emergence of features were in kindergarten and third grade (5–6 and 8–9 years old). These students were acquiring English in school with predominantly Spanish as their first language. Development of explanations by a cohort of English monolingual or proficient students provides grade-specific comparison language trajectories. The results are placed within the context of a formative assessment framework in order to assist teachers and students in placing explanations at different phases of sophistication on the progressions. This facilitates charting development and identifying with greater specificity which language and discourse features might be effective targets of contingent instruction to promote students’ oral explanation abilities.

Empowering Mathematical Practices

A formative assessment framework is interpreted in light of the gaps between student work and proficient uses of the mathematical practices.

SAUDI TEACHERS’ PRACTICES OF FORMATIVE ASSESSMENT: A QUALITATIVE STUDY

Shifting from teacher-centred to student-centred practices requires teachers to understand strategies to interact with students in science classes. Formative assessment strategies are very critical component of classroom interaction where teachers obtain information about student learning wherever possible. Traditionally, however, teachers ask questions and evaluate student responses but without investigating student contributions to the classroom interaction. This qualitative study aimed at developing teachers’ knowledge of formative assessment strategies when teaching science-based inquiry in Saudi Arabia. 12 teachers were observed when teaching science and details of one teachers’ practices of formative assessment is presented in this study. Formative assessment framework that describes assessment conversations is used and modified to observe teachers’ assessment practices. Assessment conversation consists of four-step cycles, where the teacher elicits information from students through questioning, the student responds, the teacher recognizes the student’s response, and then uses the information to develop further inquiry. Findings indicate that teachers ask questions and receive responses but rarely allow students to share their own ideas or discuss their own thinking. The study underlines the importance of integrating formative assessment strategies during scientific inquiry teaching for professional development as a way to increase student participation and allow opportunities for students’ inquiry in science classes. Key words: assessment conversations, formative assessment, science inquiry.

Using Formative Assessment to Improve Presentation Skills

The art of presenting is a critical skill that must be taught to middle school students. How can teachers make the skills used to give an oral presentation explicit? How can teachers teach students to systematically track progress and strengthen presentation skills? This article describes how one English and humanities teacher used the formative assessment framework to teach students to develop their oral presentation skills. Research on the effectiveness of formative assessment and the importance of teaching presentation skills is highlighted along with a discussion on the instructional process and student growth seen in this unit.

Application of grey relational analysis to expose individual student's cognitive difficulties in English public speaking

Purpose – The purpose of this paper is to propose a formative assessment framework to expose individual student's cognitive learning difficulties in English public speaking. The paper aims to provide student feedback and information during the teaching and learning process. A grey student-construct (S-C) chart is developed to represent the students’ cognitive mapping of the speech difficulties in relation to their overall speech conceptualization. This grey S-C chart can facilitate the instructors to ameliorate the classroom teaching and learning performance in English public speaking. Design/methodology/approach – In total, 26 students in a class of English Speech and Rhetoric participate in the experiment – each student views the online video segments of a great speaker's speech, and then decides what segments would best support the speaking skill constructs and also reflects on his/her own difficulties in the same constructs. The grey relational analysis (GRA) method is used to analyze the empirical data. The individual student's construct localization grey relation grade values are calculated to rank the grey relation for both students and constructs. Accordingly, a grey S-C matrix is constructed and a grey S-C chart can thus be developed. Findings – The grey S-C chart manifestly displays the cognitive difficulties in sequences of both students and constructs. Practical implications – According to the grey S-C chart, the instructors may modify teaching strategies to enhance the overall classroom performance. The students may adjust learning strategies to eliminate their specific difficulties. Offering individualized advanced and remedial practices to those largely deviating from the norm is also possible. Originality/value – The study is the first of its kind to apply the GRA method to expose individual student's cognitive learning difficulties in English public speaking. The grey S-C chart is novel in education literature, which can reveal individual student's learning difficulty patterns.

Development and pilot study of the Primary Care Practice Improvement Tool (PC-PIT): an innovative approach.

To assess the usability and validity of the Primary Care Practice Improvement Tool (PC-PIT), a practice performance improvement tool based on 13 key elements identified by a systematic review. It was co-created with a range of partners and designed specifically for primary health care. This pilot study examined the PC-PIT using a formative assessment framework and mixed-methods research design. Six high-functioning general practices in Queensland, Australia, between February and July 2013. A total of 28 staff participated - 10 general practitioners, six practice or community nurses, 12 administrators (four practice managers; one business manager and eight reception or general administrative staff). Readability, content validity and staff perceptions of the PC-PIT. The PC-PIT offers an appropriate and acceptable approach to internal quality improvement in general practice. Quantitative assessment scores and qualitative data from all staff identified two areas in which the PC-PIT required modification: a reduction in the indicative reading age, and simplification of governance-related terms and concepts. The PC-PIT provides an innovative approach to address the complexity of organisational improvement in general practice and primary health care. This initial validation will be used to develop a suite of supporting, high-quality and free-to-access resources to enhance the use of the PC-PIT in general practice. Based on these findings, a national trial is now underway.