Continuity equations associated with continuous-time Markov processes can be considered as Euclidean Schrödinger equations, where the non-Hermitian quantum Hamiltonian H=divJ is naturally factorized into the product of the divergence operator div and the current operator J . For non-equilibrium Markov jump processes in a space of N configurations with M links and C=M−(N−1)⩾1 independent cycles, this factorization of the N × N Hamiltonian H=I†J involves the incidence matrix I and the current matrix J of size M × N, so that the supersymmetric partner H^=JI† governing the dynamics of the currents existing on the M links is of size M × M. To better understand the relations between the spectral decompositions of these two Hamiltonians H=I†J and H^=JI† with respect to their bi-orthogonal basis of right and left eigenvectors that characterize the relaxation dynamics towards the steady state and the steady currents, it is useful to analyze the properties of the singular value decomposition of the two rectangular matrices I and J of size M × N and the interpretations in terms of discrete Helmholtz decompositions. This general framework concerning Markov jump processes can be adapted to non-equilibrium diffusion processes governed by Fokker–Planck equations in dimension d, where the number N of configurations, the number M of links and the number C=M−(N−1) of independent cycles become infinite, while the two matrices I and J become first-order differential operators acting on scalar functions to produce vector fields.