KDM4A-F enzymes are a subfamily of histone demethylases containing the Jumonji C domain (JmjC) using Fe(II) and 2-oxoglutarate for their catalytic function. KDM4 enzymes are overexpressed or deregulated in cancer, thus leading to alteration in chromatin structure and transcriptional defects. As KDM4 enzymes have been associated with malignancy, they may represent novel targets for developing innovative therapeutic tools to treat different solid and blood tumors, of note, KDM4A is the isozyme most frequently associated with aggressive phenotypes of these tumors. To this aim, industrial and academic medicinal chemistry efforts have identified different KDM4 inhibitors. In most cases, these are pan-KDM4 inhibitors, with low selectivity against other Jumonji family members. The pharmacophoric features of the inhibitors frequently include a chelating group capable of coordinating the catalytic iron within the active site of the KDM4 enzyme. Nonetheless, non-chelating compounds have also demonstrated promising inhibitory activity, suggesting potential flexibility in the drug design. Several natural products, containing monovalent or bivalent chelators, have been identified as KDM4 inhibitors, albeit with a micromolar inhibition potency. This highlights the potential for leveraging them as templates for the design and synthesis of new derivatives, exploiting nature's chemical diversity to pursue more potent and selective KDM4 inhibitors.