ABSTRACT The need for accurate solar power forecasting is critical for grid stability as solar energy becomes more prevalent. This paper presents a new framework called Cloud-based Analysis and Integration for Data Efficiency (CAIDE) for real-time monitoring and forecasting of solar irradiance in sensor farms. CAIDE can handle multiple sensor farms, enhance predictive models in real-time, and is built on Model Based Systems Engineering (MBSE) and Internet of Things (IoT) technologies. It can correct its forecasts, ensuring they stay current, and operates on various architectures, ensuring scalability. Tested on multiple sensor farms, CAIDE proved to be scalable and improved the initial accuracy of solar power production forecasts in real-time. This framework is significant for solar plant deployment and the advancement of renewable energy.