Activity-based protein profiling (ABPP) is an effective technology for the identification and functional annotation of enzymes in complex biological samples. ABP designs are normally directed to an enzyme active site nucleophile, and within the field of Carbohydrate-Active Enzymes (CAZymes), ABPP has been most successful for those enzymes that feature such a residue: retaining glycosidases (GHs). Several mechanism-based covalent and irreversible retaining GH inhibitors have emerged over the past sixty years. ABP designs based on these inhibitor chemistries appeared since the turn of the millennium, and we contributed to the field by designing a suite of retaining GH ABPs modeled on the structure and mode of action of the natural product, cyclophellitol. These ABPs enable the study of both exo- and endo-acting retaining GHs in human health and disease, for instance in genetic metabolic disorders in which retaining GHs are deficient. They are also finding increasing use in the study of GHs in gut microbiota and environmental microorganisms, both in the context of drug (de)toxification in the gut and that of biomass polysaccharide processing for future sustainable energy and chemistries. This account comprises the authors' view on the history of mechanism-based retaining GH inhibitor design and discovery, on how these inhibitors served as blueprints for retaining GH ABP design, and on some current and future developments on how cyclophellitol-based ABPs may drive the discovery of retaining GHs and their inhibitors.