Formation of geometrically regular interference patterns in the photoelectron momentum distributions (PMDs) corresponding to the photoionization of atoms by two single-color, crossing ultrashort pulses is investigated both analytically and numerically. It is shown that, in contrast to the photoionization by monochromatic pulses, PMDs for the ionization by crossing and co-propagating broadband pulses are essentially different (unless both pulses are linearly polarized), namely, when one pulse is linearly polarized along the propagation direction, $\stackrel{\ifmmode \hat{}\else \^{}\fi{}}{\mathbf{k}}$, of the circularly polarized (CP) pulse, then interference maxima (minima) of the ionization probability have the form of three-dimensional single-arm regular spirals which are wound along $\stackrel{\ifmmode \hat{}\else \^{}\fi{}}{\mathbf{k}}$. Next, the interference maxima (minima) of the ionization probability by a pair of crossing elliptically polarized pulses have the form of either Newton's rings or two-arm Fermat's spirals, depending on the position of a detection plane. Remarkably, these regular patterns occur only for certain values of the pulse ellipticities, and they become distorted for CP pulses. For both above-mentioned pulse configurations, the features of interference patterns depend on the time delay between pulses, their relative electric field amplitude, and relative carrier-envelope phase. Our predictions, illustrated by the numerical results for the ionization of H and He atoms by two orthogonal pulses, are quite general and we expect them to be valid for the ionization of any randomly oriented atomic or molecular target.