Obtaining accurate and timely estimates of socio-economic status at fine geographical resolutions is essential for global sustainable development and the fight against poverty. However, data related to local socio-economic dynamics in rural villages is often either unavailable or outdated. To fill this gap, predicting local economic well-being with satellite imagery and machine learning has shown promising results. While most state-of-the-art analyses focus on predicting the levels of socio-economic status, finding temporal changes in rural villages’ economic well-being is essential for tracking the impacts of public policies (targeting e.g., poverty alleviation or access to various public services). In this paper, we propose an approach that utilizes pixel-wise differences in satellite images to classify temporal changes in average and median consumption expenditures (and income) in rural villages in Thailand and Vietnam between 2007 and 2017. This approach is shown to be able to distinguish between “Decline”, “Stagnation” and “Growth” in these outcomes with an F1 score of up to 63.2% using an Extreme Gradient Boosting Classifier model. In addition, we employ regression-based approaches which achieve an R2 of up to 39.5% when predicting actual changes in these outcomes with an Extreme Gradient Boosting Regressor. Our study demonstrates the feasibility of satellite-based estimates for measuring changes in local socio-economic dynamics.