Temporal modes (TMs) of photons provide an appealing high-dimensional encoding basis for quantum information. While techniques to generate TM states have been established, high-dimensional decoding of single-photon TMs remains an open challenge. In this work, we experimentally demonstrate demultiplexing of five-dimensional TMs of single photons with an average fidelity of 0.96±0.01, characterized via measurement tomography. This is achieved with use of a newly developed device, the multi-output quantum pulse gate (MQPG). We demonstrate a proof-of-principle complete decoder based on the MQPG that operates on any basis from a set of six five-dimensional mutually unbiased bases and is therefore suitable as a receiver for high-dimensional quantum key distribution. Furthermore, we confirm the high-quality operation of the MQPG by performing resource-efficient state tomography with an average fidelity of 0.98±0.02.3 MoreReceived 20 September 2022Accepted 15 March 2023DOI:https://doi.org/10.1103/PRXQuantum.4.020306Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.Published by the American Physical SocietyPhysics Subject Headings (PhySH)Research AreasIntegrated opticsNonlinear waveguidesOptical quantum information processingQuantum communicationQuantum gatesQuantum opticsQuantum tomographyQuantum Information