Alzheimer's disease (AD) is a neurodegenerative disorder and a principal basis of dementia in the elderly population globally. Recently, human carbonic anhydrases (hCAs, EC 4.2.1.1) were demonstrated as possible new targets for treating AD. hCAs are vital for maintaining pH balance and performing other physiological processes as they catalyze the reversible hydration of carbon dioxide to bicarbonate and a proton. Current research indicates that hCA plays a role in brain functions critical for transmitting neural signals. Activation of carbonic anhydrase (CA) has emerged as a promising avenue in addressing memory loss and cognitive issues. Conversely, the exploration of CA inhibition represents a novel frontier in this field. By enhancing glial fitness and cerebrovascular health and blocking amyloid-β (Aβ)-induced mitochondrial dysfunction pathways, cytochrome C (CytC) release, caspase 9 activation, and H2O2 generation in neurons, CA inhibitors improve cognition and lessen the pathology caused by Aβ. Recent research has pushed hCAs into the spotlight as critical players in AD pathogenesis and precise therapeutic targets. The captivating dilemma of choosing between hCA inhibitors and activators looms large, as inhibitors reduce Aβ aggregation and improve cerebral blood flow, while activators enhance cerebrovascular functions and restore pH balance. The current review sheds light on the clinical evidence for hCAs and the roles of inhibitors and activators in AD. Additionally, this review offers a fascinating outlook on the data that may aid medicinal chemists in designing and developing new leads that are more effective and selective for upcoming in vitro and in vivo studies, allowing for the discovery and introduction of novel drug candidates for the treatment of AD to the market and into the clinical pipeline.