Summary Production of oil from carbonate rocks is very challenging due to their inherent nature, such as detection, complex wettability, pore structure, and low recovery factor. Nanoparticles (NPs) are recognized as remarkable materials for a wide range of research and commercial applications due to their physical properties and characteristics. Extensive research in recent years has shown that nanoscience can provide great potential for the development of carbonate reservoirs and enhanced oil recovery (EOR). In this study, the carbonate core plug samples were prepared from an Iranian reservoir. At first, the wettability capacity of the core samples was evaluated. This process was carried out by evaluating wettability changes using the contact angle of base fluid and nanofluid. The potential of the NPs (ZnO, TiO2, and ZrO2) to change the wettability was experimentally tested in the loading NPs from 0.01 wt% to 0.5 wt% by the contact angle method. Wettability studies have shown that nanofluids can influence wettability variability from oil-wet to water-wet quality. About 0.05 wt% of NPs was found to be the optimal concentration to affect wettability change. The same behavior was observed for all nanofluids at the same NP loading; while TiO2 showed better performance with a sharp change from an oil-wet state (θ = 151.9°) to a water-wet state (θ = 111.3°), ZnO, and ZrO2 changed wettability to a moderately-wet condition (θ = 108.6° and 118.6°, respectively) at 0.05 wt% NP loading. We conclude that TiO2-based nanofluids have great potential as EOR agents, and TiO2 is very impressive in its strong water-wettability. The highest oil recovery in the optimal amount for all three nanofluids was obtained as 35.2%, 23.2%, and 25.6%, respectively, for TiO2, ZnO, and ZrO2 nanofluids. Furthermore, we considered the effect of nanofluids on the recovery performance of the brine/oil system for carbonate core samples. The results showed that nanofluids can significantly imbibe into the core sample, and as a result, the final oil recovery is significant.