A renormalizable UV model for axionlike particles or hidden photons, which may explain the dark matter, usually involves a dark Higgs field, which is a singlet under the standard model (SM) gauge group. The dark sector can couple to the SM particles via the portal coupling between the SM-like Higgs and dark Higgs fields. Through this coupling, the dark sector particles can be produced in either the early Universe or the collider experiments. Interestingly, not only the SM-like Higgs boson can decay into the light dark bosons, but also a light dark Higgs boson may be produced and decay into the dark bosons in a collider. In this paper, we perform the first collider search for invisible decays by taking both the Higgs bosons into account. We use a multivariate technique to best discriminate the signal from the background. We find that a large parameter region can be probed at the International Linear Collider operating at the center-of-mass energy of 250 GeV. In particular, even when the SM-like Higgs invisible decay is a few orders of magnitude below the planned sensitivity reaches of the International Linear Collider and the high luminosity LHC, the scenario can be probed by the invisible decay of the dark Higgs boson produced via a similar diagram. Measuring the dark Higgs boson decay into the dark sector will be a smoking gun signal of the light dark sector. A similar search of the dark sector would be expected in, e.g., the Cool Copper Collider, the Circular Electron Positron Collider, the Compact Linear Collider, and the Future Circular electron-positron Collider.