Competence Evaluation of Participants in a Wheat Improvement Research Training Course

Abstract

The goal of The International Maize and Wheat Improvement Center (CIMMYT) wheat (Triticum aestivum L.) improvement training course is to produce competent wheat improvement specialists who are able to act as effective agents of research in their national wheat research programs. The course is evaluated annually to monitor changes in training needs, modify course curriculum, and to document training program impact. The objective of the study is to assess the usefulness and/or efficiency of three evaluation methods to measure the competence of course participants: (i) self-assessment, (ii) theoretical, and (iii) practical assessment. Preand postcourse evaluation scores of 112 program alumni from 37 countries from the 1986 to 1990 period were examined. A comparison of results obtained from theoretical and practical examinations and selfassessments seemed to provide reasonable measurement of group competence and change. Based on the correlation made between assessment methods, there exists an agreement between competence assessments measured by instructors and self ratings by trainees. Differences in ratings observed across years serve to alert trainers about changes that can be made to improve the course; course organization can then be adjusted accordingly. CONTINUAL of skills of IMPROVEMENT agricultural researchers, production specialists, and farmers in developing countries who are concerned with food production is vital to the future progress and well-being in developing countries. Since its establishment in 1966, the International Maize and Wheat Improvement Center (CIMMYT) has maintained and kept its firm commitment to collaborate with national research institutions to improve their research and human resource capabilities to better address the needs of their client farmers. In this context, CIMMYT has offered a range of educational and training opportunities to agricultural scientists in national research and production programs. CIMMYT’s training philosophy emphasizes the practical application of skills on learning by doing. The CIMMYT Wheat Improvement Training Program (CWITP) is one of the largest educational activities CIMMYT intended to produce competent wheat improvement specialists who can take leadership roles in their national crop breeding research program. The basic focus of the course is on the identification of farmer and market needs in relation to plant and grain type and biotic and abiotic constraints that limit production in vatR.L. Villareal and E. del Toro, Wheat Program, CIMMYT, Lisboa 27, Apartado Postal 6-641, Delegacion Cuauhtemoc 06600 Mexico, D.F., Mexico. Contribution from the Wheat Program of the International Maize and Wheat Improvement Center (CIMMYT). Received 20 Mar. 1992. *Corresponding author. Published in J. Nat. Resour. Life Sci. Educ. 22:44-48 (1993). iOUS geographic areas. Participants learn to identify germplasm sources and the most efficient technologies to be used in a breeding program. They learn how to characterize varieties and lines, maintain improved germplasm, and produce basic seed and commercial germplasm. Although the course emphasizes germplasm improvement research, crop management as well as other important topics are included (CIMMYT, 1990). Through 1991, this program has provided training to more than 550 young breeders and plant pathologists from more than 80 developing countries. In attempts to better teach skills needed to conduct a wheat improvement program, the course is evaluated annually to monitor changes in training needs and modify course curriculum and to document training program impact. Importance of topics taught in the course is assessed annually to keep up with changing needs of our diverse clients. Similarly, participants’ opinions are solicited to tailor the course to their individual or group needs. This provides valuable information for topic prioritization and other modifications in the course curriculum. Finally, CIMMYT staff based in the developing countries provide feed-back on skills they consider essential for scientists doing wheat breeding/pathology research. Consequently, this information is used to improve our course. Among the many methods used to evaluate the participants’ competence in the CIMMYT training programs, graded homework, laboratory exercises, written and practical tests, informal observation, and self-assessment are the most commonly used. Raab and Bell (1990) reviewed some advantages and disadvantages of these methods in assessing and documenting immediate impact of a crop management training program at CIMMYT. The principal objective of the study is to assess the usefulness and/or efficiency of three evaluation methods to measure the competence of participants in the CWITP: (i) self assessment, (ii) theoretical, and (iii) practical sessment. The study also presents results of efforts by CWITP instructors to modify course content in response to participants’ needs and to document and assess the competence of its trainees. MATERIALS AND METHODS From 1986 through 1990, 112 CWITP trainees’ competence in wheat improvement work was assessed routinely by instructors at the beginning and end of the training course. Participants originated from 37 developing countries. Participants’ competence was measured Abbreviations: CIMMYT, The International Maize and Wheat Improvement Center; CWITP, CIMMYT Wheat Improvement Training Program. 44 J. Nat. Resour. Life Sci. Educ., Vol. 22, no. 1, 1993 using the self assessment (trainee-assessed), theoretical, and practical assessments (trainer-assessed).