Recently, the use of ammonia, a carbon-free fuel, in internal combustion engines, particularly in dual fuel dual direct injection engines, has attracted wide attention. However, the spray and combustion characteristics of diesel and ammonia dual direct injection especially on cross injections remain unclear. An optical study of diesel and ammonia spray and combustion was conducted using a constant-volume combustion chamber. The results revealed that spray tip penetration (STP) and spray projected area (SPA) of ammonia are lower than those of diesel, indicating that ammonia has a higher evaporation rate and a smaller diffusion rate than diesel. Besides, diesel and ammonia atomization was promoted through cross injection and collisions. As the cross injection interval increased, the liquid-phase STP of the collision spray increased, and its liquid-phase SPA decreased, while its vapor-phase SPA increased, promoting the diffusion and evaporation rates of the collision spray. In addition, increasing the interval of diesel and ammonia injection can shorten the ignition delay, and increase the flame lift-off length, leading to a more intense combustion process and less soot emissions. Therefore, the combustion and emission characteristics can be effectively improved by adjusting the injection timing of the two fuels reasonably.