Understanding the formation and decomposition mechanisms of aerosolized ammonium nitrate species will lead to improvements in modeling the thermodynamics and kinetics of aerosol haze formation. Studying the sputtered mass spectra of cation and anion ammonium nitrate clusters can provide insights as to which growth and evaporation pathways are favored in the earliest stages of nucleation and thereby guide the development and use of accurate models for intermolecular forces for these systems. Simulated annealing Monte Carlo optimization followed by density functional theory optimizations can be used reliably to predict minimum-energy structures and interaction energies for the cation and anion clusters observed in mass spectra as well as for neutral nanoparticles. A combination of translational and rotational mag-walking and sawtooth simulated annealing methods was used to find optimum structures of the various heterogeneous clusters identifiable in the mass spectra. Following these optimizations with ωB97X-D3 density functional theory calculations made it possible to rationalize the pattern of peaks in the mass spectra through computation of the binding energies of clusters involved in various growth and dissociation pathways. Testing these calculations against CCSD(T) and MP2 predictions of the structures and binding energies for small clusters demonstrates the accuracy of the chosen model chemistry. For the first time, the peaks corresponding with all detectable species in both the positive and negative ion mass spectra of ammonium nitrate are identified with their corresponding structures. Thermodynamic control of particle growth and decomposition of ions due to loss of ammonia or nitric acid molecules is indicated. Structures and interaction energies for larger (NH4NO3)n nanoparticles are also presented, including the prediction of new particle morphologies with trigonal pyramidal character.