Five-year (2013–2017) particulate matter (PM) data observed at an urban site, Srinagar, Kashmir Himalaya, India was used to examine the temporal variability, meteorological impacts and potential source regions of PM. The daily mean PM10 and PM2.5 concentration was 135 ± 112 μg/m3 and 87 ± 93 μg/m3 respectively with significant intra- and inter-daily variation. The annual PM10 and PM2.5 concentration was 2.0–3.2 and 1.7–2.8 times higher than the annual Indian National Ambient Air Quality Standards (PM10 = 60 μg/m3 and PM2.5 = 40 μg/m3). PM concentration shows a bimodal diurnal pattern with morning and evening peaks, which coincide with the increased anthropogenic activity and shallow planetary boundary layer (PBL). The combined effect of the low temperature, low wind speed, shallow and stable PBL and geomorphic setup of Kashmir valley leads to the accumulation of particulate pollution during autumn and winter and the converse meteorological conditions leads to dispersion, dilution and deposition during spring and summer. High precipitation rate (>15 mm/day) removes the coarse particles (PM10) more efficiently than fine particles (PM2.5), while as the moderate to high humid conditions (55–95%) leads to the accumulation and growth of more PM. It was observed that ~80% of the air masses arriving at the site during spring, autumn and winter are westerlies. Source contribution analysis revealed that highly potential source regions of PM at the site are neighboring Pakistan, Afghanistan, parts of Iran and Trans-Gangetic Plains, which could contribute high concentration of the PM10 (>250 μg/m3) and PM2.5 (>150 μg/m3) during autumn and winter. The high PM load observed at the site during autumn and winter, with major contribution from the anthropogenic source emissions like biomass and coal burning, fossil fuel combustion and suspension of road dust, is aggravated by the geomorphic and meteorological setup of the Kashmir valley.