Industrial commercialization of perovskite solar cells not only depends on sufficient device performance, but also requires complete elimination of hazardous solvents in the fabrication process to enable sustainable development of the technology. This work reports a new solvent system based on sulfolane, gamma-butyrolactone (GBL), and acetic acid (AcOH) as a significantly greener alternative to common but more hazardous solvents. Interestingly, this solvent system not only resulted in densely-packed perovskite layer of bigger crystal size and better crystallinity, the grain boundaries were found to be more rigid and highly conductive to electrical current. The physical changes at the grain boundaries were due to the sulfolane-infused crystal interfaces, which were expected to facilitate better charge transfer and provide stronger barrier to moisture within the perovskite layer, yielding higher current density and longer performance of the device as a result. In fact, by using a mixed solvent system consisting of sulfolane, GBL, and AcOH in the volume ratio of 70.0:27.5:2.5, the device stability was better and the photovoltaic performance was statistically comparable with those prepared using DMSO-based solvent. Our report reflects unprecedented findings of enhanced electrical conductivity and rigidity of the perovskite layer simply by using an appropriate choice of the all-green solvent.