Solar power generation converts solar radiation into electrical energy. It is the most environmentally friendly green energy source in modern times, but the solar radiation reception rate is unstable due to weather. The general weather forecast is for the climate of a large area and cannot provide effective real-time prediction to the area where the power plant generating radiant energy from solar radiation. The sky imager can collect the sky image of the location of the solar power panel in real time, which can help to understand the weather conditions in real time, especially the dynamics of the clouds, which is the main reason for affecting the solar power generation. In this study, the optical flow method was used to analyze the motion vectors of clouds in the sky image, thereby estimating the changes of clouds in a short time, and the correlation between the distribution of clouds in the sky and the radiation of the whole sky images was analyzed through a neural network. The change further predicts the change in radiation across the sky, thereby effectively assessing the efficiency of solar power generation.