The objective of this study is mainly to analyze the drying kinetic parameters, effective diffusivity, and thermodynamic performance indicators (energy, exergy, heat, and mass transfer coefficients) of tea under different drying conditions of different drying temperatures (DT) and thin layer thicknesses (TT). Experimental drying was conducted at drying temperatures of 70°C, 80°C, and 90°C with thin layer thicknesses of 10 mm, 15 mm, and 20 mm. The results show that a higher drying temperature and a lower thin layer thickness can increase evaporation moisture content and shorten drying time. By evaluating and comparing the fitting of five drying models adopted by the coefficient of determination (R2) and chi-square (χ2), it can be found that the logarithmic model is the best to describe drying behavior. The effective moisture diffusivity shows a positively correlated trend with the increase in DT and TT, with the value of activation energy ranging from 14.030 to 22.344 kJ mol−1 K−1. The specific moisture evaporation rate (SMER), energy efficiency, exergy efficiency, and sustainability index (SI) descend as the TT increases at all DT; the specific energy consumption (SEC) and improvement potential (IP) rate perform in an opposite manner, but the TT remains unchange. The conclusion drawn from the thermodynamic parameters is opposite to the aforementioned. As the TT increases, the heat and mass transfer coefficients show a significant decrease trend. In addition, the heat and mass transfer coefficients are given as functions of DT and TT, and further knowledge shows that the mass transfer coefficient is positively correlated with DT but the heat transfer coefficient is negatively correlated. In conclusion, this article provides new insights into the effects of drying characteristics, energy consumption characteristics and heat and mass transfer characteristics in the process of tea drying under different drying conditions, and provides certain theoretical reference bases for promoting the optimization of industrialized tea drying production machinery design and drying process optimization.