The evaluation of college physical education (PE) teaching quality is an indispensable part of the teaching process. Building a scientific, comprehensive, reasonable and effective evaluation system is crucial to improving the quality of college PE classroom teaching. This process is not easy, and requires long-term efforts and persistence. The PE teaching quality evaluation in Colleges and Universities is frequently viewed as the multiple attribute decision making (MADM) issue. In such paper, Taxonomy method is designed for MADM under double-valued neutrosophic sets (DVNSs). First, the score function of DVNSs and Criteria Importance Through Intercriteria Correlation (CRITIC) method is used to derive the attribute weights. Second, then, the optimal choice is obtained through calculating the smallest double-valued neutrosophic number (DVNN) development attribute values from the DVNN positive ideal solution (DVNNPIS). Finally, a numerical example for PE teaching quality evaluation is given to illustrate the built method.