In this study, a novel three-step learning-based machine learning (ML) methodology is developed utilizing 26 000 experimental records from The Perovskite Database Project. A comprehensive set of 29 features encompassing both categorical and numerical data was utilized to train various ML models for various solar cell performance metrics, including open-circuit voltage (VOC), short-circuit current (JSC), fill factor (FF), and power conversion efficiency (PCE). The model accuracy was assessed using four key metrics: mean absolute error, mean square error, root mean square error, and R2 score. Among the constructed models, random forest (RF) emerged as the standout performer, boasting an R2 score of 0.70 for PCE. This RF model was then used for prediction on the large, optimized design pool of Sn-based perovskite data with intent to probe a viable non-toxic substitute to the standard Pb-based absorber. A three-step algorithm was tailored, which led to the discovery of a new set of feature combinations, showcasing a PCE improvement over the existing peak performance of Sn-based devices. The key aspects identified were device architecture, dimensionality, and deposition procedures for essential layers, including the electron transport layer, the hole transport layer, the perovskite absorber layer, and the back-contact. Through consideration of these features, an impressive increase in PCE was achieved. There was a 28.35% increase in PCE from 12.24% to 15.71% for architecture optimization and a 24.6% increase in PCE from 12.24% to 15.25% for deposition method optimization. This study additionally addresses the effective implementation of target encoding applied to a diverse set of categorical feature labels. The data-driven methodology proposed in this study allows scientists to efficiently identify an optimal architecture and deposition parameters for non-toxic Sn-based perovskite materials with a much higher anticipated device PCE compared to traditional trial-and-error analyses. Further exploration and exploitation of the current investigation is expected to lead to successful and sustainable development of highly efficient Sn-based perovskite solar cells.