The Brazilian Amazon land cover changes rapidly due to anthropogenic and climate drivers. Deforestation and forest disturbances associated with logging and fires, combined with extreme droughts, warmer air, and surface temperatures, have led to high tree mortality and harmful net carbon emissions in this region. Regional attempts to characterize land cover dynamics in this region focused on one or two anthropogenic drivers (i.e., deforestation and forest degradation). Land cover studies have also used a limited temporal scale (i.e., 10–15 years), focusing mainly on global and country-scale forest change. In this study, we propose a novel approach to characterize and measure land cover dynamics in the Amazon biome. First, we defined 10 fundamental land cover classes: forest, flooded forest, shrubland, natural grassland, pastureland, cropland, outcrop, bare and impervious, wetland, and water. Second, we mapped the land cover based on the compositional abundance of Landsat sub-pixel information that makes up these land cover classes: green vegetation (GV), non-photosynthetic vegetation, soil, and shade. Third, we processed all Landsat scenes with <50% cloud cover. Then, we applied a step-wise random forest machine learning algorithm and empirical decision rules to classify intra-annual and annual land cover classes between 1985 and 2022. Finally, we estimated the yearly land cover changes in forested and non-forested ecosystems and characterized the major change drivers. In 2022, forest covered 78.6% (331.9 Mha) of the Amazon biome, with 1.4% of secondary regrowth in more than 5 years. Total herbaceous covered 15.6% of the area, with the majority of pastureland (13.5%) and the remaining natural grassland. Water was the third largest land cover class with 2.4%, followed by cropland (1.2%) and shrubland (0.4%), with 89% overall accuracy. Most of the forest changes were driven by pasture and cropland conversion, and there are signs that climate change is the primary driver of the loss of aquatic ecosystems. Existing carbon emission models disregard the types of land cover changes presented in the studies. The twenty first century requires a more encompassing and integrated approach to monitoring anthropogenic and climate changes in the Amazon biome for better mitigation, adaptation, and conservation policies.