This paper explores the socio-ecological changes perceived by the X-hamlet local community in Bangka Island before and after the spread of large-scale tin mining and how it adapted to those changes. Using evidence collected by household surveys, combined with key informant interviews and focus group discussions, this study shows that the spread of tin mining activity on large and small scales were perceived differently by subsistence groups within this hamlet as a key driver of coastal ecosystem and land tenure system changes, leading to income uncertainty. The household economic conditions, resource availability, relationships, and networking are important factors influencing household decisions on diversifying income sources. Nonetheless, the lack of capital (physical, financial, human), limited skill, and low education levels constrained to them in diversifying their income sources. Thus, landless households are facing a greater challenge in adapting, particularly fishers who are facing ongoing fish depletion yields due to suction dredger and small-scale coastal mining. The landless fishers are potentially marginalized by engaging in mining activity which is an economical, socially, and environmentally unsustainable alternative livelihood. Therefore, future policies need to address those key issues for securing local’s lives and livelihoods.