Practices in instrument use and development in chemistry education research and practice 2010–2021

Many of the instruments developed for research use by the chemistry education community are relatively new. Because psychometric evidence dictates the validity of interpretations made from test scores, gathering and reporting validity and reliability evidence is of utmost importance. Therefore, the purpose of this study was to investigate what “counts” as psychometric evidence within this community. Using a methodology based on concepts described and operationalized in the Standards for Educational and Psychological Testing, instruments first published in the Journal between 2002 and 2011, and follow-up publications reporting the use of these instruments, were examined. Specifically, we investigated the availability of evidence based on test content, response processes, internal structure, relations to other variables, temporal stability, and internal consistency. Findings suggest that our peer review and reporting practices value some types of evidence while neglecting others. Results of this study serve...

Almost everyone who teaches chemistry in the K-12 system (or its foreign equivalents) and almost everyone employed as a faculty member in a chemistry department qualifies as a chemical educator: we are chemists interested in helping others understand chemistry. One way to look at the chemical education community is to divide our activities into a spectrum of three intertwined branches: instruction, practice, and research. The branches intertwine because many of us are active in more than one branch.Instruction is familiar to all of us. Even if we do not engage in instruction, we have been on the receiving end. Instructors use their knowledge to assist their clientele’s learning. It is not difficult to identify the largest group of instructors: we are teachers in K-12 classes or faculty in post-secondary classrooms and teaching laboratories at all levels (from technical schools and two-year colleges to medical and graduate schools). Graduate teaching assistants, who bear a significant part of the responsibility for delivering instruction at many institutions, constitute another group. However, instruction occurs in settings other than the classroom and teaching laboratory. Tutors who staff learning centers are instructors. Research directors who direct the laboratory work of undergraduate and graduate students are instructors. The chemical education component of their activities lies in the transmission of attitudes, skills, and habits of inquiry to their students.Many chemical educators are practitioners. Practitioners coordinate or direct programs and develop the tools and methods used to teach chemistry. The obvious practitioners are directors of general chemistry or directors of teaching laboratories. Others of us include software developers, textbook authors, and those who develop laboratory experiments or lecture demonstrations. Less obvious may be those involved in curriculum development, outreach, and teacher preparation. We should also include institutional staff at the ACS, NSF, and government departments of education in addition to laboratory managers and many other professional staff at post-secondary institutions. Another important and overlooked group are reviewers. Their work goes almost unnoticed, yet a thoughtful review can greatly improve a textbook, laboratory experiment, or journal article.A smaller group of chemical educators do research in chemical education. Those engaged in chemical education research examine what works and why or why not. Some are members of schools of education; others are members of chemistry departments. Chemical education researchers can provide tested, theory-based, or data-based insights and methodologies to the chemical education community. We focus on a variety of basic research questions. How and why do students learn? Why is chemistry difficult, even for many good students? What works to facilitate effective learning

The first page of this article is displayed as the abstract.

In this chapter, we review recent trends in the philosophy of chemistry and its applications in chemical education. Chemistry has maintained quite a peripheral existence in the philosophy of science for a long time, thus evading focused attention and critical analysis. However, since the 1990s an increasing number of books, journals, conferences and associations focused on philosophy of chemistry highlighting the contributions of chemistry to philosophy of science (Bhushan and Rosenfeld, Of minds and molecules: new philosophical perspectives on chemistry. Oxford University Press, Oxford, 2000; Hendry, The metaphysics of chemistry. Oxford University Press, 2012; McIntyre and Scerri, Synthese 111(3):211–212, 1997; Scerri and McIntyre, Synthese 111(3):213–232, 1997; Schummer, The philosophy of chemistry: From infancy toward maturity. In: Baird D, Scerri E, McIntyre L (eds) Philosophy of chemistry: synthesis of a new discipline. Springer, Dordrecht, pp 19–39, 2006; Van Brakel, Ambix 57(2):233–234, 2010; Van Brakel, Synthese 111(3):253–282, 1997; Woody, Philosophy of Science 67 (Proceedings):S612–S627, 2000). The uptake of this new domain in the context of chemical education research and practice has been minimal despite some earlier acknowledgment of the potential significance for chemical education (Erduran, Science & Education 10:581–593, 2001; Gilbert et al. Research and development for the future of chemical education. In: Gilbert et al. (eds) Chemical education: towards research-based practice. Kluwer, Dordrecht, pp 391–408, 2003). The special edition of the Science & Education journal on ‘Philosophy, Chemistry and Education: An Introduction’ (Erduran, Science & Education, 2013) is the first collection where the work on the applications of philosophy of chemistry in chemical education has been collated. This chapter will begin with an overview of some of the key and example debates in philosophy of chemistry. These examples will include themes such as reductionism (e.g. Scerri, Journal of Chemical Education 68(2):122–126, 1991) and supervenience (e.g. Papineau, Arguments for supervenience and physical realization. In: Savellos EE, Yalcin U (eds) supervenience: new essays. Cambridge University Press, 1995) as well as aspects of chemical knowledge such as laws (e.g. Christie and Christie, “Laws” and “theories” in chemistry do not obey the rules. In: Bhushan N, Rosenfeld S (eds) Of minds and molecules. Oxford University Press, Oxford, pp 34–50, 2000), models (e.g. Woody, Science & Education, 2013) and explanations (e.g. Hendry, The chemical bond: structure, energy and explanation. In: Dorato M, Redei M, Suarez M (eds) EPSA: Philosophical issues in the sciences: launch of the European Philosophy of Science Association. Springer, Berlin, pp 117–127, 2010.). Second, the implications of these themes for chemical education research and practice will be explored. The central argument is that understanding of how chemistry is conceptualised and how chemistry is learned, chemical education research has to be informed by the debates about the epistemology and ontology of chemistry. The discussion will be contextualised in the area of nature of science (NOS) that has been one of the highly studied areas of research in science education (Chang et al. Journal of Science Education and Technology, 2010). Contributions of how philosophy of chemistry can contribute to the characterisation of NOS by nuanced perspectives on the nature of chemistry will be discussed. Theoretical perspectives and empirical studies on NOS have tended to focus on domain-general aspects of scientific knowledge with limited understanding of domain-specific ways of thinking. NOS literature can be further developed both theoretically and empirically, thereby contributing more to HPS studies in science education. Third, some applications of philosophy of chemistry in chemical education will be reviewed in more detail. For example, proposed work for secondary chemical education, including the context of the teaching of periodic law through argumentation, will be visited (e.g. Erduran, Foundations of Chemistry 9(3):247–263, 2007). Fourth, the chapter will argue that there is developing potential for reciprocal interplay between philosophy of chemistry and chemical education. While philosophy of chemistry has the potential to influence chemistry education, chemistry education in turn can influences philosophy of chemistry, particularly in relation to empirical foundations of chemical reasoning. The paper will conclude with some recommendations on the future directions of research in chemical education that is informed by philosophy of chemistry.

This editorial coincides with my start as Editor for Chemistry Education Research and Practice (CERP). Since the purpose of CERP is to serve the chemistry education community of authors and readers, this editorial describes my reflection on how CERP serves the chemistry education community. CERP provides a ready venue for authors to share chemistry education research (CER) and for researchers and educators to learn from this research. By focusing exclusively on CER, it has served to differentiate CER from more general education research and scholarship in teaching and learning products. As a result, CERP provides clear recognition of CER including to those outside the field of chemistry education. A particular strength of CERP is the number of reviewers who provide constructive feedback within their reviews. This feedback supports authors in advancing their work and serves the readers by improving the quality and relevance of the work that appears in CERP. In closing, possibilities for how CERP may better serve the chemistry education community are raised as an ongoing discussion with the community.

This special issue focuses on the research and development, as well as pedagogical approaches, of the implementation of green and sustainable chemistry practices within the framework of chemistry education, as showcased at ECRICE 2024.The 16th European Conference on Research in Chemical Education took place at NOVA School of Science and Technology, Campus da Caparica, Portugal, between September 5 and 7, 2024.This conference on research in chemical education represented a significant opportunity to share new findings and advancements in the field.Understanding how learners acquire knowledge and how to facilitate and stimulate this process is vital.It is essential to explore several learning environments, embracing new educational tools and innovative approaches that integrate neuroeducation, technology, and artificial intelligence into chemical education to enhance student engagement.However, in the current context, these efforts alone are not sufficient.It is imperative to view these initiatives through the lens of sustainability, particularly in alignment with the 17 Sustainable Development Goals (SDGs) and the 2030 Agenda for Sustainable Development. 1 Therefore, ECRICE 2024s theme was "Chemical Education for Sustainable Development: Empowering Education Communities", Figure 1.The 17 Sustainable Development Goals (SDGs) proposed by the United Nations and adopted in 2015, emphasise sustainable and environmentally friendly chemistry.Since then, educational systems have begun to integrate these goals, promoting a future that values both human and environmental well-being. 1,2As a result, practical chemistry education increasingly reflects sustainability and green chemistry (GC) principles, integrating them in the curriculum. 2,3Teachers play a crucial role by incorporating green activities, microscale experiments, and ecofriendly reactants, significantly influencing students' sustainable practices and behaviours. [3][4]4][5][6] Laboratory work plays a pivotal role in chemistry education, 7-9 not only because it helps connect theory to practice, boosts motivation, increases students' interest in learning science, supports the acquisition of laboratory skills and techniques, and improves understanding of fundamental procedural and conceptual knowledge (such as concepts, principles, laws, and theories), but also because it also fosters scientific attitudes like rigour, persistence, reasoning, critical thinking, creativity, objectivity, curiosity, responsibility, and cooperation.Engaging in laboratory activities enhances critical thinking and problem-solving abilities, enabling students to apply the scientific method through trial and error.It also improves scientific reasoning by familiarising students with processes of scientific inquiry.Moreover, it can inspire curiosity and support personal growth by promoting social skills through collaborative activities.Ultimately, laboratory work is rooted in active learning: 10-14 it transforms students into active participants by allowing them to experiment, manipulate materials, and directly engage with scientific phenomena.And knowing these, the focus of implementing green (GC) and sustainable chemistry (SC) in schools is rooted in school laboratory practices. 14,15It is important to note that although sustainable chemistry (SC) provides a broader perspective than green chemistry (GC), green chemistry aims to minimise waste, reduce energy consumption, and improve safety in chemical processes to lessen harmful impacts; it mainly focuses on

Chemistry education research (CER) ranges from understanding the history and philosophy of chemistry, which guides on us how chemistry knowledge was developed, to the developments and application of modern technologies and tools for a more effective teaching of chemistry. CER plays a mediator role in translating recent discoveries in the field of chemistry into content that can be understood by students. Like in many academic disciplines, it is necessary for chemistry educators to pause periodically and take stock of what kind of research we are doing and where chemistry education is going. A content analysis of research papers can guide scholars with a strong indication of the extent to which journal editors and scholars prioritize research in the chemistry education field and whether there have been changes in the subject matters studied and research methods employed over time. This chapter focuses on the development of research in chemistry education in Turkey through a content analysis of 1338 research papers published in peer-reviewed journals and compares it to international research published in high status journals that publish CER. It starts with a brief introduction to the Turkish education system and teaching chemistry as a discipline in Turkey. Attention then moves to the research in chemistry education in the world and Turkey. Content analyses of CER papers published by Turkish chemistry educators are compared with CER published by highly respected international journals. The results indicated that although CER has showed a visible increase in Turkey since 2000 and the number of national and international publications is increased, there are still problems with publishing high quality research papers in respected international journals. The chapter concludes with a discussion on the status and future of CER in Turkey.

The aim of this study was to develop the Mathematics Vocabulary Test (MVT)-an instrument to identify young children with a limited mathematics vocabulary-in a multilingual majority country-South Africa. This study consists of two substudies with children aged 3-8.5 years (N = 988, ngirls = 429). In Study 1, a 26-item MVT was developed by multiprofessional expert panels and piloted in four languages, isiZulu (n = 229), Sesotho (n = 83), English (n = 89), and Afrikaans (n = 216). Study 1 provided evidence of content validity, and the MVT was further revised based on the results. In Study 2, additional samples were assessed with the revised version of the MVT in English (Stage 1, n = 270) and isiZulu (Stage 2, n = 101) to provide further evidence of reliability and validity for these two language versions of the test. Confirmatory factor analyses supported structural validity of a unidimensional structure, including 20 items in the English version and 16 items in the isiZulu version. The structure of the English MVT showed stability across time (T2 5 months after T1). Both versions showed good reliability in terms of internal consistency. Our findings also provided evidence of concurrent and known-group validity for both language versions, as well as predictive validity of the English version of the test. The English and isiZulu MVT can be used as a measure of mathematics vocabulary in educational practice and research with young children. (PsycInfo Database Record (c) 2026 APA, all rights reserved).

Assessment instruments developed specifically for chemistry classrooms have increased in number over the past decade. In the design, development, and evaluation of these instruments, the chemical education community has adopted many of the practices and standards used by the greater assessment communities. Methodologies for creating new assessment instruments now include collecting broad evidence for the validity of the uses and interpretations of data derived from an assessment instrument. The focus of this study is the design, development, and qualitative evaluation of concept inventory items for the Thermochemistry Concept Inventory (TCI). Qualitative research studies were used to obtain feedback from the primary stakeholders of the TCI. Evidence for content and response process validity are provided and used as arguments against the two threats to validity: construct underrepresentation and construct-irrelevant variance. In addition, a determination of the most important thermochemical topics taught i...

Australia is presented as a unique but fertile context in terms of chemistry education research and practice. While focusing on the tertiary sector, the influence and partnerships with secondary education researchers is also recognized. A metareview of publications in key chemistry and science education research journals between 2008-2017 has been analysed to identify the breadth of chemistry education research by Australians as well as concentrations of excellence. It was found that the field is underpinned by strong leaders, mentors and role models, academics representing multiple STEM disciplines engage in publishing their chemistry education-based research. Also, the nature of research is maturing from ontological focused questions to epistemological studies.

Identifying effective methods of assessment and developing robust assessments are key areas of research in chemistry education. This research is needed to evaluate instructional innovations and curricular reform. In this primer, we advocate for the use of a type of assessment, ordered multiple-choice (OMC), across postsecondary chemistry. OMC assessments are grounded in a developmental perspective, which treats students’ knowledge as developing in sophistication over time. This is in contrast to a dichotomous perspective, which asserts that students’ knowledge is either aligned or misaligned with scientifically accepted knowledge. By drawing on a developmental perspective, OMC assessments offer insights into student understanding that can be useful for informing instruction. To that end, this primer will overview OMC assessments, illustrate their development and evaluation in two chemistry contexts, and make an argument for their utility in the chemistry education community.

To facilitate the chemistry education community in locating and evaluating published assessment instruments, the Chemistry Instrument Review and Assessment Library (CHIRAL) encompasses a number of resources. First and foremost, CHIRAL contains a catalog of over 500 assessment instruments that is easily searchable, allowing for the identification of instruments within a given domain, topic, or format. Each instrument listing in CHIRAL includes metadata (intended population, language, number of items, etc.), a bibliography of studies that have used the instrument and reported evidence for validity and reliability, a catalog of the reported evidence, a panel review report providing a synthesis of the reported validity and reliability evidence (for select instruments), and a glossary of common terms used in psychometric evaluations. This paper presents the purpose of CHIRAL and provides details about its development.

The tradition of qualitative research drives much of chemistry education research activity. When performing qualitative studies, researchers must demonstrate the trustworthiness of their analysis so researchers and practitioners consuming their work can understand if and how the presented research claims and conclusions might be transferable to their unique educational settings. There are a number of steps researchers can take to demonstrate the trustworthiness of their work, one of which is demonstrating and reporting evidence of reliability. The purpose of this methodological review is to investigate the methods researchers use to establish and report reliability for chemistry education research articles including a qualitative research component. Drawing from the literature on qualitative research methodology and content analysis, we describe the approaches for establishing the reliability of qualitative data analysis using various measures of inter-rater reliability and processes including negotiated agreement. We used this background literature to guide our review of research articles containing a qualitative component and published in Chemistry Education Research and Practice and the Journal of Chemical Education from the years 2010 through 2019 for whether they report evidence of reliability. We followed this by a more in-depth analysis of how articles from the years 2017 through 2019 discuss reliability. Our analysis indicates that, overall, researchers are presenting evidence of reliability in chemistry education research (CER) articles by reporting reliability measures, describing a process of negotiated agreement, or mentioning reliability and the steps taken to demonstrate it. However, there is a reliance on reporting only percent agreement, which is not considered an acceptable measure of reliability when used on its own. In addition, the descriptions of how reliability was established were not always clear, which may make it difficult for readers to evaluate the veracity of research findings. Our findings indicate that, as a field, CER researchers should be more cognizant of the appropriateness of how we establish reliability for qualitative analysis and should more clearly present the processes by which reliability was established in CER manuscripts.

The current article presents the findings from a systematic review of the available reliability and validity evidence supporting the use of criterion-referenced assessments based on the applied behavior analysis framework. We identified 46 studies that reported reliability and/or validity evidence for six assessments, 37 of which presented reliability evidence and 43 presented validity evidence. Additionally, we extracted and summarized information related to participant characteristics (e.g., age, sex, diagnosis), geographic location, and research setting (e.g., residential facility, home). Overall, we found conflicting support for the use of the assessments. When coupled with the reported usage by behavior analysis professionals, our findings suggest a misalignment between the reportedly used assessments and the number of published studies providing validity and/or reliability evidence. We found inconsistent use of measurement-related vocabulary and that many studies could have been strengthened by conducting different statistical analyses. We provide a summary of studies, findings, and offer recommendations for clinical practice and future measurement research.

Chemistry education research (CER) as a field is inherently interdisciplinary and has traditionally borrowed ideas, frameworks, and methodologies from other fields, such as anthropology, psychology, cognitive science, and science education more broadly. In this paper we encourage researchers to continue this tradition by utilizing the rich body of literature that exists outside of CER, specifically looking to communities interested in mathematics education and physics education to expand the research carried out in our field. Previous work situated in university-level mathematics and physics involves considerations and concerns shared by the chemistry education community, such as integrating conceptual and mathematical reasoning during problem solving. We also briefly discuss and draw attention to a recent ACS Symposium Series book, It’s Just Math: Research on Students’ Understanding of Chemistry and Mathematics, that illustrates the rich area of inquiry at the interface of chemistry and mathematics. An overview of frameworks that have been productive for investigating students’ mathematical reasoning in a chemistry context is provided, encouraging researchers to engage in work that crosses disciplinary boundaries and promotes discussion between experts from different fields.