With the development of modern society and the improvement of living standards, care for special needs children has been increasingly highlighted, and numerous corresponding measures such as welfare homes, special education schools, and youth care centers have emerged. Due to the lack of systematic emotional companionship, the mental health of special needs children are bound to be affected. Nowadays, emotional education, analysis, and evaluation are mostly done by psychologists and emotional analysts, and these measures are unpopular. Therefore, many researchers at home and abroad have focused on the solution of psychological issues and the psychological assessment and emotional analysis of such children in their daily lives. In this paper, a special children’s psychological emotional analysis based on neural network is proposed, where the system sends the voice information to a cloud platform through intelligent wearable devices. To ensure that the data collected are valid, a series of pretreatments such as Chinese word segmentation, de-emphasis, and so on are put into the neural network model. The model is based on the further research of transfer learning and Bi-GRU model, which can meet the needs of Chinese text sentiment analysis. The completion rate of the final model test has reached 97%, which means that it is ready for use. Finally, a web page is designed, which can evaluate and detect abnormal psychological state, and at the same time, a personal emotion database can also be established.