Sort by
Evolution of a self-renewing, participant-centered workshop series in BMB assessment.

We present as a case study the evolution of a series of participant-centered workshops designed to meet a need in the life sciences education community-the incorporation of best practices in the assessment of student learning. Initially, the ICABL (Inclusive Community for the Assessment of Biochemistry and Molecular Biology/BMB Learning) project arose from a grass-roots effort to develop material for a national exam in biochemistry and molecular biology. ICABL has since evolved into a community of practice in which participants themselves-through extensive peer review and reflection-become integral stakeholders in the workshops. To examine this evolution, this case study begins with a pilot workshop supported by seed funding and thoughtful programmatic assessment, the results of which informed evidence-based changes that, in turn, led to an improved experience for the community. Using participant response data, the case study also reveals critical features for successful workshops, including participant-centered activities and the value of frequent peer review of participants' products. Furthermore, we outline a train-the-trainer model for creating a self-renewing community by bringing new perspectives and voices into an existing core leadership team. This case study, then, offers a blueprint for building a thriving, evolving community of practice that not only serves the needs of individual scientist-educators as they seek to enhance student learning, but also provides a pathway for elevating members to positions of leadership.

Open Access
Relevant
Building ICABL: An Inclusive Community for the Assessment of Biochemistry and Molecular Biology Learning

Assessment is a critical feature of effective instruction. Beyond assigning a grade to student performance, regular assessment can provide instructors, departments, and institutions with ongoing feedback on instructor, course, and program effectiveness. Despite its importance, designing assessments that are accessible to all students and measure relevant learning outcomes can be challenging for many biochemistry and molecular biology (BMB) instructors because they receive little, if any, formal training in assessment practices. Consequently, we ‐ a team of writers for the ASBMB Certification Examination ‐ have launched ICABL, an inclusive community for the assessment of BMB learning. With funding from an NSF grant (Award No. 2018204), we piloted a virtual workshop on summative assessment in Summer 2020. The 28 participants discussed best practices in summative assessment, including Bloom’s taxonomy, backward design using the ASBMB Foundational Concepts and Skills, and rubrics development as tools for informing instructors on the effectiveness of instruction. An explicit objective of the workshop was to broaden representation in the ASBMB education community. Accordingly, 68% of participants taught at minority‐serving institutions, as compared with less than 10% of current ASBMB membership. Both immediate and six‐month follow‐up surveys highlighted the efficacy of this virtual workshop in supporting participants’ professional development. In addition, we have subsequently recruited many of the participants to write and score for the ASBMB Certification Exam as one step in our goal to develop an examination team that better represents and can more effectively address the diversity of individuals in our BMB classrooms. With continued support from the NSF (Award No. 2120673), over the next three years we will be offering a series of additional workshops, both in the United States and overseas, addressing summative, formative, and alternative assessment.

Relevant
Community‐supported Development of an Annual Exam Assessing Undergraduate Competencies in Biochemistry and Molecular Biology

Each year, volunteers from the biochemistry and molecular (BMB) community come together to construct and score the American Society for Biochemistry and Molecular Biology (ASBMB) Certification Exam, a tool provided to ASBMB-accredited programs for assessing key competencies in the discipline. Grounded in a community consensus about core BMB concept and skill areas, the annual exam is designed to evaluate undergraduate students’ competence in the areas of energy and metabolism; information storage and transfer; macromolecular structure, function, and assembly; and skills including analytical and quantitative reasoning. First offered in 2014, this assessment tool is now representative of a relatively mature exam development process. The one-hour exam consists of 12 questions, with a mix of multiple-select/multiple-choice and constructed-response formats, balanced across the four concept and skill areas and addressing both lower- and higher-order cognitive processing levels. Each constructed response is scored by a team of at least three BMB scientist-educators, and inter-rater reliability is calculated to ensure consistency. All questions are piloted and revised before they contribute to students’ exam scores. To date, nearly 5,000 students from over 70 colleges and universities have taken the ASBMB exam. Of these, an average of approximately 42% of students per year have scored sufficiently well to earn “Certification” of their exam performance by ASBMB; approximately 13% of students have earned “Certification with Distinction”. Upwards of 120 scientist-educators – with professional affiliations ranging from small, primarily undergraduate institutions to large research universities – have contributed to question development and/or scoring. Many volunteers have participated over multiple years; for example, 97% of the 2020 scorers plan to score again in 2021. Future directions include building the community of volunteers, expanding the question bank, delivering the exam online (in spring of 2021), and investigating the potential of the ASBMB Certification Exam to inform programmatic assessment.

Open Access
Relevant
An Inclusive Workshop Centered on Assessment of Biochemistry and Molecular Biology Student Learning Outcomes

Assessment of student learning is a cornerstone of biochemistry and molecular biology (BMB) education. Yet few BMB instructors receive meaningful professional development in best practices in assessment. To promote such training in the BMB education community, we conducted a workshop on writing questions for summative assessment in the summer of 2020. Recognizing the individual and institutional homogeneity in our BMB education community, we recruited workshop participants primarily from the Southeastern United States due to the multitude of Historically Black Colleges and Universities and Hispanic-Serving Institutions in the region. 28 participants were selected to provide diversity in individual and institutional demographics. Led by six members of the ASBMB Accreditation and Certification Exam Team, the online workshop, spread across nine days, featured whole-group discussions interspersed with small-group activities. Post-workshop surveys revealed significant gains in self-reported professional development in assessment creation. Surveys also highlighted the inclusive environment of the workshop. 43% of the workshop participants were subsequently recruited into the ASBMB Certification Exam Team, providing fresh voices and perspective to the group. This workshop is an excellent example of how the intentional partnership with individuals and institutions from historically marginalized populations can begin a movement toward necessary and meaningful change in the BMB education community.

Open Access
Relevant