Due to increasing emissions and global warming, in parallel with the increasing world population and energy needs, IMO has introduced severe rules for ships. Energy efficiency on ships can be achieved using the organic and inorganic Rankine cycle (RC) driven by exhaust heat from marine diesel engines. In this study, toluene, R600, isopentane, and n-hexane as dry fluids; R717 and R718 as wet fluids; and R123, R142b, R600a, R245fa, and R141b as isentropic fluids are selected as the working fluid because they are commonly used refrigerants, with favorable thermal properties, zero ODP, low GWP and are good contenders for this application. The cycle and exergy efficiencies, net power, and irreversibility of marine diesel engine exhaust-driven simple RC and RC with a recuperator are calculated. For dry fluids, the most efficient fluid at low turbine inlet temperatures is n-hexane at 39.75%, while at high turbine inlet temperatures, it is toluene at 41.20%. For isentropic fluids, the most efficient fluid at low turbine inlet temperatures is R123 with 23%, while at high turbine inlet temperatures it is R141b with 23%. As an inorganic fluid, R718 is one of the most suitable working fluids at high turbine inlet temperatures of 300 °C onboard ships with a safety group classification of A1, ODP of 0, and GWP100 of 0, with a cycle efficiency of 33%. This study contributes to significant improvements in fuel efficiency and reductions in greenhouse gas emissions, leading to more sustainable and cost-effective maritime operations.