This work implements pionless effective field theory with the two-nucleon system expanded around the unitarity limit at second-order perturbation theory. The expansion is found to converge well. All Coulomb effects are treated in perturbation theory, including two-photon contributions at next-to-next-to-leading order. After fixing a three-nucleon force to the binding energy at this order, proton–deuteron scattering in the doublet S-wave channel is calculated for moderate center-of-mass momenta.