One of the biggest environmental worries in the world today is the risk of arsenic (As) contamination in groundwater. The Atomic Absorption Spectrometer (AAS) was used in this work to assess the As content in groundwater samples from 38 shallow (27 m) tubewells in northwest Bangladesh to determine the existing situation, potential source(s), and likely health risk of As and other important water quality parameters. The range of arsenic concentrations (μgL−1) was troublesome and greater than the WHO recommended level for drinking water, ranging from 0.50 to 164 (mean ± SD: 20.22 ± 36.46). In groundwater, the concentrations of Fe, and Mn vary from 0.04 to 52.75 mgL−1 (mean ± SD: 4.23 ± 9.68), and 0.23 to 3.27 mgL−1 (mean ± SD: 1.10 ± 0.67). The obtained groundwater samples have pH values ranging from 5.9 to 7.1, which indicates a somewhat acidic to neutral character. Major cations have an average abundance that is as follows: Ca2+ > Mg2+ > Na+ > K+, while major anions have an average abundance that is as follows: HCO3− > Cl− > SO42− > NO3−; Ca2+ and HCO3− are the main cation and anion, respectively. The groundwater in the Rajarampur village was deemed unfit for drinking or irrigation based on analyses of water quality performed using the entropy water quality index. The Ca–HCO3 type of water, in which Ca2+ and HCO3− are the main positive ions and negative ions, is suggested by the Piper tri-linear diagram. It was discovered that silicate weathering regulates the hydro-geochemical activities in groundwater using a bi-variate examination of several hydro-chemical variables. Four major clusters were observed for the water sample. According to reductive dissolution processes and principal component analysis, the arsenic in groundwater is geogenic in origin. Arsenic is discharged from sediment to groundwater by reductive dissolution of FeOOH and MnOOH, as shown by the modest connection between As, Fe, and Mn. The United Nations Environmental Protection Agency's (USEPA) suggested value for probable cancer risk assessment was 10−6, however the probable cancer risk assessment found a higher value, indicating that the population in the study region was at high risk for cancer. Remedial measures for arsenic mitigation include removing arsenic from groundwater after it is extracted, searching for alternative aquifers, and implementing various water-supply technologies such as dugwells, deep tubewells, pond-sand filters, and rainwater harvesting systems.