The present era is a complex, diversified and global knowledge economy era. Adult higher education in China is faced with many challenges in obtaining and maintaining its competitive advantage. In order to deal with these challenges and improve the competitiveness, we must take the increment of human capital of adult college teachers as the premise, and teachers’ continuing education is an important means. However, in the actual operation process, many teacher trainings are eager for quick success and instant benefits, and fails to grasp the rational training strategy of team building from a strategic perspective. At present, some trainers are armchair due to the lack of front-line teaching experience, which makes the training effect too wet to be applied in actual combat or has guiding and reference significance (Shi, 2007). This paper takes Zhejiang Open University teaching staff training center in nearly three years project as the research subject, through the analysis of the existing training effect evaluation model of the commonly used at home and abroad, analyzes the model’s application environment and evaluation level and so on, is open to Zhejiang university system problems that exist in the teacher training effect evaluation activities carried on the investigation and study, and analyzes the reasons of these problems. Through the construction of effective training effect evaluation system and the corresponding evaluation model to solve these problems. Referring to the academic achievements of evaluation models and the application examples of enterprises, this paper constructs a training effect evaluation system for Zhejiang Open University from the perspectives of evaluation objective, evaluation model, main body method and training effect evaluation process. For the training effect evaluation system designed in the paper also gives the corresponding implementation steps, but also gives the case results. In the evaluation, the four-level classification method of Kirkpatrick Model is mainly used for reference, and the evaluation of response, learning, behavior and result is carried out at four levels. To explore the feasibility of applying this training effect evaluation model to Open University teacher training system, and to derive the training effect evaluation system and training effect evaluation model which are in accordance with scientific principles and the actual situation of Open University. On the basis of extensive literature collection and analysis, the expected value of this paper is intended to realize the research on training effect evaluation by combining system with emphasis, examples with theory, model display with logical reasoning, and analyzing practical problems. It is believed that the training effect evaluation system and the training effect evaluation model designed in this paper can provide thinking methods and reference ways for the evaluation of the system teacher training effect of Zhejiang Open University.