The study of dust-acoustic (DA) nonlinear electrostatic waves in dusty plasma is crucial for understanding plasma behavior in both astrophysical and laboratory environments. Dusty plasmas, characterized by the presence of negatively charged dust particles, exhibit complex dynamics influenced by various factors, including nonthermal electron and ion populations following Cairns–Gurevich distributions. This study addresses the problem of understanding wave propagation under these specific conditions by employing a set of fluid hydrodynamic equations for dust fluid, alongside appropriate electron and Cairns–Gurevich ion distributions, to model the dynamics and propagation of DA nonlinear electrostatic waves under specific plasma conditions with negatively charged dust particles. We derived a nonlinear Zakharov–Kuznetsov (ZK) equation to model the evolution of these waves and further transformed it into the nonlinear Schrödinger (NLS) equation to analyze rogue wave formation and identify unstable and stable zones within the plasma. We focused our analysis on the effects of key parameters, such as the nonthermal index, magnetic field strength, negative dust temperature ratio, polarization force, and density ratio, on the behavior of dust-acoustic waves (DAWs). The results demonstrated that soliton waves, explosive waves, and kink waves exhibit distinct behaviors depending on these parameters and the spatial context of Earth's magnetosphere. These findings provide new insights compared to previous studies into the conditions under which these waveforms emerge and evolve, especially in magnetized environments where earlier models were less effective at accurately characterizing or predicting wave behavior. By applying two different analytical methods, a direct integration approach and a generalized Kudryashov method, we expanded our understanding of nonlinear wave phenomena in dusty plasmas. Our results not only advance theoretical knowledge but also have practical implications for interpreting space plasma observations and guiding experimental design in plasma physics research. This study thus contributes to a more comprehensive understanding of plasma dynamics, with potential applications to astrophysical observation and laboratory plasma experimentation.