The production of lepton pairs in the Higgs boson decay $h \to \ell^+ \ell^- \gamma$ is studied. The emphasis is put on the structure of the Higgs boson interaction with the fermions. This interaction is chosen as a mixture of the scalar and pseudo-scalar couplings, and, in addition, it is supposed to be non-Hermitian. We study prediction of this model for the observables in the $h \to \ell^+ \ell^- \gamma$ decay for the $e^+ e^-$, $\mu^+ \mu^-$ and $\tau^+ \tau^-$ pairs. The differential decay width and lepton forward-backward asymmetry are calculated as functions of the dilepton invariant mass for several sets of $h f \bar{f}$ coupling constants. The influence of non-Hermitian $h f \bar{f}$ interaction on the forward-backward asymmetry is studied, and large influence of a possible non-Hermiticity of the Higgs interaction with the top quarks on forward-backward asymmetry for $e^+ e^-$ and $\mu^+ \mu^-$ pairs is stressed.