Mangroves are one of the world’s most productive and ecologically important ecosystems, and they are threatened by the widespread invasion of Spartina alterniflora Loisel in China. As few studies have examined the spatial pattern differences of S. alterniflora invasion and the nearby mangroves in different latitudes, we chose the Zhangjiang Estuary and the Dandou Sea, two representative mangrove–salt marsh ecotones in the north and south of the Tropic of Cancer, as the study areas for comparison. The object-based image analysis and visual interpretation methods were combined to construct fine-scale mangrove and S. alterniflora maps using high-resolution satellite imagery from 2005 to 2019. We applied spatial analysis, centroid migration, and landscape indexes to analyze the spatio–temporal distribution changes of mangroves and S. alterniflora in these two ecotones over time. We used the landscape expansion index to investigate the S. alterniflora invasion process and expansion patterns. The annual change rates of mangrove and S. alterniflora areas in the Zhangjiang Estuary showed a continuous growth trend. However, the mangrove areas in the Dandou Sea showed a fluctuating trend of increasing, decreasing, and then increasing again, while S. alterniflora areas kept rising from 2005 to 2019. Spartina alterniflora showed larger annual change rates compared with mangroves, indicating rapid S. alterniflora invasion in the intertidal zones. The opposite centroid migration directions of mangroves and S. alterniflora and the decreasing distances between the mangrove and S. alterniflora centroids indirectly revealed the fierce competition between mangroves and S. alterniflora for habitat resources. Both regions saw a decrease in mangrove patch integrality and connectivity. The integrality of mangrove patches in the Zhangjiang Estuary was always higher than those in the Dandou Sea. We observed the growth stage (2011–2014) and outbreak stage (2014–2019) of S. alterniflora expansion in the Zhangjiang Estuary and the outbreak stage (2005–2009) and plateau stage (2009–2019) of S. alterniflora expansion in the Dandou Sea. The expansion pattern of S. alterniflora varies in time and place. Since the expansion of S. alterniflora in the outbreak stage is rapid, with a large annual change rate, early warning of S. alterniflora invasion is quite important for the efficient and economical removal of the invasive plant. Continuous and accurate monitoring of S. alterniflora is highly necessary and beneficial for the scientific management and sustainable development of coastal wetlands.