Developing prospective teachers’ language assessment literacy through courses: a comparative case study in Chinese as a second language teaching environment
Abstract Language assessment literacy (LAL) ensures the appropriate design, implementation, and utilization of various language assessments (Taylor 2009). Taking language assessment courses (LACs) is a common approach to foster LAL, particularly among prospective language teachers, as previous research has explored. However, limited studies have compared LACs with different focuses. This study addresses this question by examining two cases of LACs for post-graduate students in a Chinese university preparing to become Chinese as a second language (CSL) teachers. These two courses, differing in purpose and target audience (teaching-oriented and research-oriented), are both introductory courses for beginners learning about language assessment. Drawing on Taylor’s (2013) model and Kremmel and Harding’s (2020) questionnaire, we investigated graduate students’ perceptions regarding their development of LAL in the respective courses, combining observation, questionnaires, and interviews. The findings reveal that students perceived a comprehensive improvement in their LAL levels, with the item-writing session regarded as particularly beneficial and applicable. Despite the challenges posed by theoretical concepts and the involvement of statistics, the students considered that a general LAC was insufficient and further learning opportunities were needed. The study emphasizes updating the need analysis and practice-based design of LACs.
- Research Article
21
- 10.14483/22487085.14514
- Nov 7, 2019
- Colombian Applied Linguistics Journal
Language Assessment Literacy (LAL) research has focused on defining the knowledge, skills, and principles that the stakeholders involved in language assessment activities are required to master. However, there is scarce research on the relationship between LAL and the professional development of language teachers. Therefore, this exploratory action research study examined the impact of a language assessment course on pre-service teachers in a Colombian language teaching programme. Data were collected through questionnaires, interviews, teacher and researcher journals and class observations. The findings show that the course promoted theoretical, technical and operational dimensions in the language assessment design practices of the participants. In addition, it enhanced their LAL and professional development. Consequently, this study contends that the LAL course changed language assessment perceptions radically and encouraged pre-service teachers to design assessments conscientiously, a feature not explicitly stated in LAL research involving this group of stakeholders elsewhere.
- Research Article
133
- 10.1177/0265532214554321
- Nov 5, 2014
- Language Testing
Despite the call for using assessment to promote effective learning, most language teachers remain underprepared to conduct classroom-based formative assessment and interpret the summative assessment information for improving instruction as well as learning. Drawing upon a survey of programme and government documents, interviews, student assessment tasks, and teaching evaluation, this paper aims to explore the overall language assessment training landscape in five Hong Kong teacher education institutions against the backdrop of assessment reforms in primary/secondary school contexts. It specifically attempts to investigate the extent to which two assessment courses may facilitate and/or inhibit the development of pre-service teachers’ language assessment literacy in one teacher education institution. Findings indicate that language assessment training in Hong Kong remains inadequate and selected language assessment courses are still unable to bridge the theory-practice gap within the assessment reform context. Implications and recommendations for promoting language assessment literacy are discussed.
- Dissertation
1
- 10.17635/lancaster/thesis/1012
- Jul 1, 2020
To date, language assessment literacy (LAL) research has primarily focused on language teachers and a range of other stakeholders (e.g. Hasselgreen et al., 2004). However, little research attention has been given to the LAL of those who prepare pre-service teachers for their future profession, i.e. teacher educators. Also, the dominant methodology in LAL research has been the survey approach, eliciting perceived needs and self-reported knowledge (e.g. Vogt & Tsagari, 2014). In response, this mixed methods study explores the LAL of teacher educators working in English teacher education programmes, in this case in Chile. First, it aimed to gain understanding of their language assessment knowledge by means of a knowledge test, the Language Assessment Literacy Inventory (LALI), which was completed by 94 teacher educators. Additionally, interviews with 20 teacher educators provided insights into their language assessment beliefs and practices, and the extent of the LAL training they conduct with pre-service teachers. Despite teacher educators’ lack of language assessment training, key findings are that they have practice-derived language assessment knowledge. This has been mainly acquired on the job through communities of practice, which were found to be enriching environments for language assessment learning. Simultaneously, contextual constraints, and teacher educators’ conceptions of language assessment influence their practices and how they develop their pre-service teachers’ LAL. Importantly, the lack of language assessment training was reported to have a direct effect on teacher educators’ language assessment practices and their conceptions of assessment. Additionally, the findings identify teacher educators as key stakeholders in the enhancement of a LAL development cascade in the language teaching profession. The study has theoretical implications through the development of the LALI instrument and a LAL model for the Teaching Profession (LAL-TEP), which describes the interrelationships between language assessment beliefs, knowledge, practices, learning, and context. The study also has practical implications for LAL development in pre- and in-service education and for policy-making in Chile.
- Research Article
20
- 10.26817/16925777.425
- Jul 4, 2018
- GiST Education and Learning Research Journal
In the field of applied linguistics, for the past fifteen years, there have been discussions about language assessment literacy (LAL) —the knowledge, skills, and principles related to assessing language ability— (Davies, 2008; Fulcher, 2012). However, the field lacks research on the professional development of language teachers, particularly pre-service language teachers, through training in language assessment. Our paper focuses on the preliminary findings of an action research study whose goal is to identify the impact of a language assessment course for pre-service teachers in a language teaching program in a state university in Colombia. Data collection for the diagnostic stage of the action research cycle used a multiple-choice questionnaire for student needs and wants, an open questionnaire for professors, an interview with an expert, and researchers’ journals. Preliminary findings indicate that there is a need to combine theory and practice of language assessment, with an emphasis on current methodologies for language teaching, assessment in bilingual education, and local policies for assessment. The paper highlights recommendations and challenges when designing a language assessment course based on insights from existing literature and includes implications for professional development.
- Research Article
- 10.26858/ijole.v7i4.47445
- Dec 31, 2023
- International Journal of Language Education
Pre-service teachers' ability to construct and conduct assessment has been a point of emphasis for decades, and rightfully so. It is crucial that they acquire the necessary knowledge and abilities in their language assessment course during their pre-service teacher education to effectively assess students in their future professional routines. The purpose of this research was to determine if and how pre-service English teachers' (PSETs) satisfaction with their language assessment course corresponded with their level of readiness. 51 out of 56 PSETs participated since they met the two requirements (passing the language assessment course and enrolling in TAP). The Fulcher (2012) language assessment literacy questionnaire was adapted and disseminated. The questions were organized into four categories for the purpose of analysis: overarching principles and concepts in linguistic assessment; designing language assessment; scoring test items and analyzing test results. Results demonstrated that LAL satisfaction was not congruent with assessment readiness. There was a "neutral" level of satisfaction among participants (51.5 percent), but they were nearly set to begin practicing assessment at their TAP (78.5 percent). Additionally included are statistics that are specific to each of the four categories found in the questionnaire. In particular, the study suggests that training in evaluating open-response questions and analyzing test items warrants expansion. Additional research could fill in the gap between LAL satisfaction and the PSETs by examining the relationship between the two.
- Research Article
1
- 10.1155/2022/4597876
- Apr 15, 2022
- Education Research International
Upon recognizing the significance of assessment literacy as a necessity for modern professional teachers, the quality of assessment courses has been examined from different angles. The present research aimed to examine the nature and functionality of assessment training at Iranian state universities in fostering the development of language assessment literacy (LAL), with a specific focus on the course instructors’ pedagogical practices (in terms of instructional materials/content and pedagogical practices) and assessment practices (including both formative and summative assessment). One hundred three course instructors were surveyed through a set of open-ended questions, and two course instructors’ pedagogical and assessment practices were observed throughout an educational semester. Based on the content and descriptive statistical analysis of the data, a lack of divergence in the instructors’ teaching and assessment practices was observable, with the majority of the instructors adhering to traditional methods, showing no inclination to adopt innovative practices. Lack of a balanced focus on all the core elements of LAL, being theory-laden and disconnected from practice in assessment, and use of dated teaching materials were recognized as factors or inappropriate practices on the part of the course instructors that might hinder the development of LAL in the researched context. Furthermore, a set of key action which might be taken by the course instructors to reduce the obstacles in developing and maintaining LAL has been suggested. Finally, limitations of the study and suggestions for future studies on LAL have been mentioned.
- Research Article
- 10.17227/folios.62-20705
- Jul 1, 2025
- Folios
Research on language assessment literacy (LAL) has focused on describing this construct for different stakeholders involved in language assessment, while paying secondary attention to pedagogical initiatives aimed at fostering LAL among teachers. This research article reports on a diagnostic study which sought to describe the LAL of forty Colombian English language teachers; the purpose of this diagnostic was to use the teachers’ feedback to design an online language assessment course. Through a mixed-methods research design, a questionnaire and a content analysis scheme were used for data collection and analysis. The convergent findings indicated issues in the design of assessment instruments and a related need to develop the teachers’ design dimension of their LAL. Implications for the design of the course are presented, based on the data generated in the study.
- Research Article
13
- 10.3389/fpsyg.2022.864582
- May 5, 2022
- Frontiers in Psychology
Language assessment literacy (LAL) is a significant component of language teachers’ expertise but is also a challenging task for most language teachers. To date, there have been relatively few studies examining the research on teachers’ LAL during these decades. To fill this void, this article reviews the conceptualizations of LAL and relevant empirical studies published from 1991 to 2021. It first analyzes various conceptualizations of LAL. Then in examining the empirical studies on teachers’ LAL, five major themes emerge: (i) teachers’ LAL levels; (ii) factors influencing LAL; (iii) language teachers’ assessment training needs; (iv) language assessment training courses; and (v) LAL development through reflection. Finally, future research directions on teachers’ LAL are discussed.
- Research Article
12
- 10.1177/02655322221134218
- Dec 27, 2022
- Language Testing
Research has shown that language teachers typically feel underprepared for assessment aspects of their job. One reason may relate to how teacher education programmes prepare future teachers in this area. Research insights into how and to what extent teacher educators train future language teachers in language assessment matters are scarce, however, as are insights into the language assessment literacy (LAL) of the teacher educators themselves. Additionally, while increasingly research insights are available on components that constitute LAL, how such components interrelate is largely unexplored. To help address these research gaps, we investigated the LAL of English as a Foreign Language teacher educators in Chile. Through interviews with 20 teacher educators and analysis of their language assessment materials, five LAL components were identified (language assessment knowledge, conceptions, context, practices, and learning), and two by-products of LAL (language assessor identity and self-efficacy). The components were found to interrelate in a complex manner, which we visualized with a model of concentric oval shapes, depicting how LAL is socially constructed (and re-constructed) from and for the specific context in which teacher educators’ practices are immersed. We discuss implications for LAL conceptualisations and for LAL research methodology.
- Research Article
2
- 10.3389/fpsyg.2024.1289126
- Feb 12, 2024
- Frontiers in Psychology
IntroductionThis research aims to investigate the impact of students’ language assessment literacy (LAL) on their cognition. The study specifically examines how different levels of LAL influence two critical factors: test anxiety and motivation to learn a second language.MethodsTo achieve the research objectives, a questionnaire was administered to a sample of 415 university students in China. The questionnaire utilized a five-point Likert scale to assess students’ levels of LAL, test anxiety, and motivation to learn a second language. Descriptive data were examined to reveal students’ proficiency in LAL, along with their levels of test anxiety and motivation. Multilevel regression analyses were performed using Mplus to investigate whether students’ LAL proficiency can predict their levels of test anxiety and motivation.ResultsThe findings indicated that the participating students had a proficiency level of approximately 60% in the content of the LAL questionnaire. The analysis further revealed the relationships between specific dimensions of LAL and both test anxiety and second language motivation. The multilevel regression analysis suggested that theoretical knowledge about language and language learning, the understanding of the impact and social value of language assessments, and the uses of assessments to enhance learning, positively predicted students’ extrinsic motivation. Furthermore, students’ understanding of the uses of assessments to learn and their theoretical knowledge about language learning were identified as positive predictors of intrinsic motivation. Additionally, it was observed that students’ LAL did not significantly predict test anxiety.DiscussionThese findings emphasize the significance of enhancing students’ LAL due to the identified relationships between LAL dimensions and motivation to learn a second language. The study suggests pedagogical implications for improving LAL, with a focus on specific dimensions that positively impact students’ motivation. The absence of a significant relationship between LAL dimensions and test anxiety prompts further exploration and consideration of additional factors influencing students’ anxiety in language assessments.
- Research Article
6
- 10.19126/suje.621319
- Dec 30, 2019
- Sakarya University Journal of Education
This study aims to review studies about foreign / second language teachers’ language assessment literacy (LAL) from 1987 to 2019. Within the scope of this study, 82 research studies and articles are investigated in the national and international spheres. Perceptions of assessment literacy are unpacked to find out language teachers’ background and needs in LAL. Subtopics are determined to categorize the research studies as assessment courses, teachers’ knowledge base in language assessment, their beliefs and practices in language assessment, their training needs in assessment, professional development in LAL, perceptions in LAL, and effect of LAL and curriculum on exam preparation. This review article indicates the general view on EFL teachers’ LAL level and makes suggestions in developing language assessment literacy.
- Research Article
22
- 10.1080/15434303.2022.2128802
- Oct 19, 2022
- Language Assessment Quarterly
Language assessment literacy (LAL), an increasingly prominent research topic, has generated substantial literature in language testing and assessment. Thus far, there seems to be few comprehensive reviews on this research topic. The current scoping study reviewed a total of 81 papers by synthesising LAL studies published from 2008 to 2020. It addressed research questions concerning (1) the overall trend and progress, (2) the research foci and (3) characteristics of implications of LAL research for language teacher education and professional development. The review found that there was an upward trend in LAL studies, which were conducted predominantly in the Asia-Pacific region, Europe and the Middle East, and that most studies employed qualitative over quantitative and mixed-methods designs. An overwhelming majority of studies focused on language teachers, especially EFL teachers, while few were conducted from the perspectives of learners, policy makers, language testers, teacher educators and other stakeholders. The review also discovered that most studies researched stakeholders’ LAL levels, needs and development, overlooking LAL developmental trajectories, localised LAL components, the development of LAL measures, perceptions of LAL and LAL impact. Three characteristics were identified from implications of LAL studies as contributions to language teacher education and professional development. Based on the findings, some guidelines were suggested for future research.
- Research Article
- 10.29408/veles.v7i1.7624
- Apr 26, 2023
- VELES: Voices of English Language Education Society
Teachers' language assessment literacy (LAL) is critical to the success of education, the quality of students' learning, and students' willingness to study. Yet, studies on teachers' LAL preparation to face the Merdeka Belajar (Freedom of Learning) curriculum are still scarce. Most LAL studies used questionnaires to assess teachers' knowledge. In contrast to that, this study utilized teachers’ LAL knowledge test adapted from Al-bahlani (2019). This study investigates teachers' self-perceived LAL consisting of competence, frequency of practice, and assessment knowledge in The Association of English Teachers Banyumas district region (MGMP) with a total of 77 participants involved by investigating teachers' self-perceived LAL consisting of competence, frequency of practice, and assessment knowledge. The current study utilized two data sources, including a questionnaire and a language assessment knowledge test to employ a quantitative methodology using MANOVA and Pearson’s product-moment correlation. The results showed both strengths and weaknesses in the teachers’ LAL, as well as matches and mismatches between teachers' self-perceived and shown assessment knowledge. Overall, EFL teachers in Banyumas regency are at a fair level of LAL and pre-service training in assessment was the variable with the greatest impact on teachers' LAL. Future research may also require investigating the objectives, actions, and outcomes of assessment training provided by teachers’ training institutes and professional development programs. Keywords: LAL, Language assessment, Language Assessment Literacy, Merdeka Belajar curriculum, Freedom of Learning Curriculum.
- Research Article
63
- 10.1186/s40468-019-0077-8
- Feb 11, 2019
- Language Testing in Asia
Language assessment literacy (LAL) is a critical field for researchers, scholars, or anyone interested in improving the language teaching environment. Understanding the basics of testing and the ability to perform testing-related activities becomes more significant in test-oriented countries. As such, in the extremely exam-oriented milieu of Bangladesh, giving tests and preparing students for high-stakes tests are the two core tasks performed by language teachers. English teachers’ readiness and ability to perform various test-related tasks determine the quality of English education in the country. In this regard, earlier studies have investigated various factors related to English language teaching. However, the assessment literacy of teachers has rarely been investigated within the context of Bangladeshi language teaching. There is no publication or broader research to understand how LAL operates in English teachers in the country. Considering the test-oriented nature of Bangladesh, it is essential to explore if the LAL of language teachers is benefitting classroom teaching and learning. Hence, this research aims to examine the nature and functionality of LAL among English teachers in Bangladesh. The study focused on two central concerns: first, whether the English teachers in the country are academically and professionally ready to perform various testing tasks; and second, how the teachers perceive LAL in their teaching practices. Semi-structured interviews were used as the data collection method for this qualitative study. The results provided insights into how the inadequate academic and professional testing background of teachers hindered their performance in conducting assessment-related tasks and contributed to their limitations in the use of assessments to improve teaching. Based on the findings, the article concludes with suggestions that can be implemented to develop language assessment awareness of English teachers in Bangladesh.
- Research Article
14
- 10.15446/profile.v22n1.78188
- Jan 1, 2020
- Profile: Issues in Teachers´ Professional Development
The language assessment literacy of English language teachers has been one of the topics of discussion in the language testing field. In this article, I focus on the need to expand research constructs and methodologies to understand, in depth, the language assessment literacy for these key players in language assessment. I first explain the need to focus on language teachers and examine current challenges in researching language assessment literacy. Then, I reflect on how post-positivist, interpretive research constructs and methodologies can expand and why they should. If this happens, research might yield more valid, useful data to unveil the complexities of language assessment literacy for language teachers. That data can provide valuable feedback to advance teachers’ professional development through language assessment literacy.
- Ask R Discovery
- Chat PDF
AI summaries and top papers from 250M+ research sources.