The characteristics of floor failure and stress changes during the mining process of protective layers are crucial for determining the effectiveness of pressure relief. Three boreholes were designed in the 21104 fully mechanized mining face of Hulusu Coal Mine to implant optical fibers into the floor of the working face. A fiber optic monitoring system was established to monitor the dynamic evolution of stress in the floor rock mass at different mining distances. Based on the information entropy in information theory, the monitoring results in the fiber optic monitoring system are calculated to obtain the stress information entropy at different mining distances. A quantitative dynamic analysis is conducted on the stress change process of the mining floor rock layer, and the stress change law of the protective layer after mining is verified through numerical calculation and similar simulation experiments. The results indicate that the evolution of stress information entropy can be divided into four stages, namely the original rock stress stage, stress concentration stage, stress release stage, and stress recovery stage. The stress information entropy shows a fluctuating upward trend, indicating that coal seam mining leads to a decrease in the orderliness of the overlying rock system and an increase in disorder. In different spatial evolution processes, there are also significant differences in stress information entropy. In the vertical direction, the entropy value of shallow rock layers changes greatly, while the entropy value of deep rock layers changes slightly. Mining leads to a decrease in the orderliness of the entire overlying rock system, an increase in stress information entropy, and a fluctuating upward trend in stress information entropy. The information entropy of overlying rock deformation and re compaction increases, but the degree of change of the former is greater than that of the latter. The Brillouin fiber optic sensing technology provides a new method for monitoring the stress changes in the protective layer mining floor, achieving quantitative analysis of floor rock failure.