Public colleges and universities are one of the most important talent training bases for China's talent-strengthening strategy. The development of colleges is fast and slow, good and bad, and it is related to the progress of social development and the development of science and technology. At the same time, colleges and universities are the legal person of the institution, and its governance structure can meet the needs of the healthy and sustainable development of colleges and universities. It is also related to the quality and development prospects of higher education in China. Therefore, it is of great significance to improve the corporate governance structure of colleges and universities. How to construct an efficient, reasonable and scientific corporate governance structure will affect the development speed of China's higher education. Based on the analysis of the status quo and problems of corporate governance structure in public universities, this paper proposes to construct a corporate governance structure from both inside and outside. In order to achieve full autonomy of colleges and universities, the university will move toward a more benign development track.