Shark cartilage presents a complex material composed of collagen, proteoglycans, and bioapatite. In the present study, we explored the link between microstructure, chemical composition, and biomechanical function of shark vertebral cartilage using Polarized Light Microscopy (PLM), Atomic Force Microscopy (AFM), Confocal Raman Microspectroscopy, and Nanoindentation. Our investigation focused on vertebrae from Blacktip and Shortfin Mako sharks. As typical representatives of the orders Carcharhiniformes and Lamniformes, these species differ in preferred habitat, ecological role, and swimming style. We observed structural variations in mineral organization and collagen fiber arrangement using PLM and AFM. In both sharks, the highly calcified corpus calcarea shows a ridged morphology, while a chain-like network is present in the less mineralized intermedialia. Raman spectromicroscopy demonstrates a relative increase of glucosaminocycans (GAGs) with respect to collagen and a decrease in mineral-rich zones, underlining the role of GAGs in modulating bioapatite mineralization. Region-specific testing confirmed that intravertebral variations in mineral content and arrangement result in distinct nanomechanical properties. Local Young's moduli from mineralized regions exceeded bulk values by a factor of 10. Overall, this work provides profound insights into a flexible yet strong biocomposite, which is crucial for the extraordinary speed of cartilaginous fish in the worlds’ oceans. Statement of significanceShark cartilage is a morphologically complex material composed of collagen, sulfated proteoglycans, and calcium phosphate minerals. This study explores the link between microstructure, chemical composition, and biological mechanical function of shark vertebral cartilage at the micro- and nanometer scale in typical Carcharhiniform and Lamniform shark species, which represent different vertebral mineralization morphologies, swimming styles and speeds. By studying the intricacies of shark vertebrae, we hope to lay the foundation for biomimetic composite materials that harness lamellar reinforcement and tailored stiffness gradients, capable of dynamic and localized adjustments during movement.