Recently Hořava proposed a renormalizable gravity theory with higher derivatives by abandoning the Lorentz invariance in UV. Here, I construct the Hořava model at λ = 1/3, where a local anisotropic Weyl symmetry exists in the UV limit, in addition to the foliation-preserving diffeomorphism. By considering linear perturbations around Minkowski vacuum for the non-projectable version of the Hořava model, I show that the scalar graviton mode is completely disappeared and only the usual tensor graviton modes remain in the physical spectrum. The existence of the UV conformal symmetry is unique to the theory with the detailed balance and this may explain the importance of the detailed balance condition in quantum gravity.