Salt marshes are vulnerable to sea-level rise, sediment deficits, and storm impacts. To remain vertically resilient, salt marshes must accrete sediment at rates greater or equal to sea-level rise. Ice-rafted debris (IRD), sediment that has been moved and deposited from ice sheets, is one of many processes that contribute to salt marsh sediment accretion in northern latitudes. On 4 January 2018, a winter storm caused major ice mobilization in the Plum Island Estuary (PIE), Massachusetts, USA, which led to large deposits of ice-rafted sediment. We aimed to quantify the volume and mass of deposited sediment, and evaluate the significance of IRD to sediment supply in Plum Island using pixel-based land-cover classification of aerial imagery collected by an Unmanned Aircraft System (UAS) and a Digital Elevation Model. Field measurements of patch thickness, and the area of IRD determined from the classification were used to estimate annual sediment accretion from IRD. Results show that IRD deposits are localized in three areas, and estimates show that IRD contributes an annual sediment accretion rate of 0.57 ± 0.14 mm/y to the study site. New England salt marsh accretion rates typically vary between 2–10 mm/y, and the average PIE sediment accretion rate is 2.5–2.7 mm/y. Therefore, this event contributed on average 20% of the annual volume of material accreted by salt marshes, although locally the deposit thickness was 8–14 times the annual accretion rate. We show that pixel-based classification can be a useful tool for identifying sediment deposits from remote sensing. Additionally, we suggest that IRD has the potential to bring a significant supply of sediment to salt marshes in northern latitudes and contribute to sediment accretion. As remotely sensed aerial imagery from UASs becomes more readily available, this method can be used to efficiently identify and quantify deposited sediment.