In a global context, the hydrochemical characteristics of shallow groundwater in coalfields exhibit high degrees of diversity and complexity that are rooted in the intricate interplay of geological variations, diverse climatic conditions, and extensive human activities. The specific types and concentrations of ions, such as Ca2+, Cl−, and NO3−, show stark differences across geographical regions. Given the crucial roles of coalfields as energy suppliers, the potential environmental contamination risks posed by mining activities to groundwater cannot be overlooked as such pollution directly impacts human health and ecological safety. This study focuses on the Huainan coal mining area in northern Anhui Province (China), where shallow groundwater samples were systematically collected and analyzed to determine the hydrochemical characteristics and ascertain the water quality status. By integrating hydrogeochemical analysis techniques with inverse modeling methods, it was revealed that the groundwater in this region is predominantly HCO3-Ca type, exhibiting weak alkaline characteristics. The formation mechanisms are primarily governed by silicate rock weathering and mineral dissolution–precipitation processes, albeit with discernible influences from human activities. PHREEQC simulations were used to further confirm the precipitation tendencies of minerals like calcite, dolomite, and fluorite as well as the significant dissolution characteristics of halite. The inverse modeling pathway analysis reveals specific hydrochemical processes along different paths: paths I and IV are notably dominated by Ca2+ dissolution–precipitation and cation exchange–adsorption processes, whereas paths II and III are closely associated with the precipitation of calcium montmorillonite as well as dissolution of kaolinite, calcite, quartz, and mineral incongruents. Moreover, evaluations based on the entropy-weighted water quality index (EWQI) indicated overall positive trends of the groundwater quality indicators within the Huainan mining area, reflecting the effectiveness of regional water quality management efforts and providing a scientific basis for future water quality protection and improvement strategies. In summary, this study not only deepens our understanding of the groundwater chemistry in the Huainan coal mining area but also underscores the importance of scientifically assessing and managing groundwater resources to address the environmental challenges potentially arising from coal mining activities.