Integrating renewable energy into the existing energy market is crucial. Solar power forecasting is essential since it depends on weather parameters and must integrate with the central grid to use the produced solar power effectively. Contemporary studies indicate that machine learning has the potential to predict the future generation of solar energy based on past data. This research demonstrates a broad range of solar power forecasting, combining the one-year time series solar power generation data, solar panel physical features, and weather information with the help of machine learning and deep learning tools with domain knowledge. The dataset is curated and preprocessed. We propose a deep learning ensemble model based on BI-LSTM. The proposed model can forecast well regardless of geographical position and is able to predict both short-term and long-term time horizons. We compared the results of the proposed model with the existing dataset and multiple standard deep learning models and found that our model produced better performance than traditional models. We also validated our model using different solar plants in Durgapur, India. For long-term forecasting, our model also outperformed the base model.