AbstractCharged particles exhibit self‐organized behaviour during the discharge state transitions inside an electrostatic cavity, along with the energy redistribution in different coherent modes with progressive anode potential. Multiple sheath formations around the spherical metallic ball anode placed inside the cavity transit to intensely glowing multiple anode spot formations (fireballs) on the anode surface with progressive anode potential. The intensely glowing anode spots reorganize over the anode surface and multiply quickly on increasing the anode potential. The nonlinear analysis of the fluctuating discharge current reveals the presence of self‐organized criticality (SOC) during different states of discharge along with a strong memory effect within (10–104) time lags in every state of discharge. The multiple anode spots exhibit long‐range correlation in the absence of a magnetic field, indicating SOC behaviour. The present study investigates energy distribution among the coherent modes of discharge through the application of the Empirical Mode Decomposition technique. The analysis indicates that the introduction of a magnetic field results in the interchange of coherent modes carrying most of the energy during multiple spot formations. The present experimental configuration produces stable multiple coherent modes along with the evolution of anodic sheath layers in the absence and then in the presence of the magnetic field. Relating SOC with such discharge transitions may help to understand the relation between complex structure formations in plasma with nonlinear aspects of glow discharge, which is of vital importance in the investigation of complexities in space plasma.