Top and Higgs flavor changing neutral couplings in two Higgs doublets model

Abstract

We study various channels of top and Higgs flavor changing neutral couplings in the two Higgs doublet model with natural flavor conservation (2HDM-I and 2HDM-II). We update known results about $t\ensuremath{\rightarrow}c\ensuremath{\gamma},cZ,cg$ and comment on $t\ensuremath{\rightarrow}c{h}^{0}$. The decays $t\ensuremath{\rightarrow}c{h}^{0}$ as well as ${{h}^{0},{H}^{0}}\ensuremath{\rightarrow}\overline{t}c$ are sensitive both to the bottom Yukawa coupling as well as to the trilinear scalar couplings ${h}^{0}{H}^{+}{H}^{\ensuremath{-}}$ and ${H}^{0}{H}^{+}{H}^{\ensuremath{-}}$. After imposing unitarity constraints as well as vacuum stability conditions on scalar sector parameters, in 2HDM-II we found that for large $\mathrm{tan}\ensuremath{\beta}\ensuremath{\gtrsim}40$ and rather light charged Higgs mass ${M}_{H\ifmmode\pm\else\textpm\fi{}}\ensuremath{\gtrsim}150\text{ }\text{ }\mathrm{GeV}$, the maximum values allowed for $\mathrm{Br}(t\ensuremath{\rightarrow}c{h}^{0})$, $\mathrm{Br}({H}^{0}\ensuremath{\rightarrow}\overline{t}c)$, and $\mathrm{Br}({h}^{0}\ensuremath{\rightarrow}\overline{t}c)$ are: $8\ifmmode\times\else\texttimes\fi{}{10}^{\ensuremath{-}5}$, ${10}^{\ensuremath{-}3}$, and ${10}^{\ensuremath{-}4}$ respectively. For charged Higgs mass in the range $[200,300]\text{ }\text{ }\mathrm{GeV}$, which can accommodate $B\ensuremath{\rightarrow}{X}_{s}\ensuremath{\gamma}$ constraint if one takes into account large theoretical uncertainties, the branching ratio of both ${H}^{0}\ensuremath{\rightarrow}\overline{t}c$ and ${h}^{0}\ensuremath{\rightarrow}\overline{t}c$ can still be slightly larger than ${10}^{\ensuremath{-}5}$. For ${A}^{0}\ensuremath{\rightarrow}\overline{t}c$, its branching ratio is smaller than $\ensuremath{\approx}{10}^{\ensuremath{-}7}$ in both 2HDM-I and 2HDM-II. We study also the top-charm associated production at ${e}^{+}{e}^{\ensuremath{-}}$ colliders and its $\ensuremath{\gamma}\ensuremath{\gamma}$ option as well as at muon colliders. It is found that the cross section of $\ensuremath{\gamma}\ensuremath{\gamma}\ensuremath{\rightarrow}\overline{t}c$ can be of the order $0.01\ensuremath{\rightarrow}0.1\text{ }\text{ }\mathrm{fb}$ near threshold region, while the cross section of ${e}^{+}{e}^{\ensuremath{-}}\ensuremath{\rightarrow}\overline{t}c$ is well below ${10}^{\ensuremath{-}2}\text{ }\text{ }\mathrm{fb}$. The situation is slightly better for muon colliders where a few fb cross section can be reached for large $\mathrm{tan}\ensuremath{\beta}$ and low center-of-mass energy $\sqrt{s}\ensuremath{\lesssim}500\text{ }\text{ }\mathrm{GeV}$.