Cancer is a global health challenge with high morbidity and mortality rates. However, conventional cancer treatment methods often have severe side effects and limited success rates. In the last decade, extensive research has been conducted to develop safe, and efficient alternative treatments that do not have the limitations of existing anticancer medicines. Plant-derived compounds have shown promise in cancer treatment for their anti-carcinogenic and anti-proliferative properties. Rosmarinic acid (RA) and carnosic acid (CA) are potent polyphenolic compounds found in rosemary (Rosmarinus officinalis) extract. They have been extensively studied for their biological properties, which include anti-diabetic, anti-inflammatory, antioxidant, and anticancer activities. In addition, RA and CA have demonstrated effective anti-proliferative properties against various cancers, making them promising targets for extensive research to develop candidate or leading compounds for cancer treatment. This review discusses and summarizes the anti-tumor effect of RA and CA against various cancers and highlights the involved biochemical and mechanistic pathways.