The IAEA Physics Section is strongly involved in the development and utilization of accelerator-based analytical techniques, which are powerful tools for the characterization of cultural and natural heritage objects and materials. Various activities are carried out with the purpose to build capacity, strengthen capabilities, transfer knowledge and foster networking in the field of heritage science. In addition, access to different X-ray fluorescence spectrometers and other analytical techniques is provided at the Nuclear Science and Instrumentation Laboratory (part of the IAEA Physics Section), and access to ion beam accelerators and synchrotron light is facilitated thanks to collaborations with Ruđer Bošković Institute (RBI) in Croatia and the Elettra Sincrotrone facility in Italy, respectively. Member States are also supported on their Research and Development programmes, as well as through the technical cooperation projects. This paper aims to provide a broad overview about how the IAEA Physics Section is engaged in the field of heritage science, promoting the safe, reliable, and effective use of ion beam, X-ray and neutron-based techniques for the characterization and preservation of cultural and natural heritage through its global networks and partners.