This paper presents a Caputo–Fabrizio fractional derivatives approach to the thermal analysis of a second grade fluid over an infinite oscillating vertical flat plate. Together with an oscillating boundary motion, the heat transfer is caused by the buoyancy force induced by temperature differences between the plate and the fluid. Closed form solutions of the fluid velocity and temperature are obtained by means of the Laplace transform. The solutions of ordinary second grade and Newtonian fluids corresponding to time derivatives of integer and fractional orders are obtained as particular cases of the present solutions. Numerical computations and graphical illustrations are used in order to study the effects of the Caputo–Fabrizio time-fractional parameter \(\upalpha \), the material parameter \(\alpha _2 \), and the Prandtl and Grashof numbers on the velocity field. A comparison for time derivative of integer order versus fractional order is shown graphically for both Newtonian and second grade fluids. It is found that fractional fluids (second grade and Newtonian) have highest velocities. This shows that the fractional parameter enhances the fluid flow.