Unified theories such as string theory and loop quantum gravity allow the Lorentz Invariance Violation (LIV) at the Planck Scale (MP ~ 1019 GeV). Using an effective field theory, this effect can be observed at low energies in terms of new interactions with a strength of ~ 1/MP. These new interactions contain operators with LIV coefficients which can be CPT-violating or CPT-conserving. In this work, we study in detail how these LIV parameters modify the transition probabilities in the next-generation long-baseline experiments, DUNE and Hyper-K. We evaluate the sensitivities of these experiments in isolation and combination to constrain the off-diagonal CPT-violating (aeμ, aeτ, aμτ) and CPT-conserving (ceμ, ceτ, cμτ) LIV parameters. We derive approximate compact analytical expressions of appearance (νμ → νe) and disappearance (νμ → νμ) probabilities in the presence of these LIV parameters to explain our numerical results. We explore the possible correlations and degeneracies between these LIV parameters and the most uncertain 3ν oscillation parameters, namely, θ23 and δCP. We find that for non-maximal values of θ23 (θ23 ≠ 45°), there exist degenerate solutions in its opposite octant for standalone DUNE and Hyper-K. These degeneracies disappear when we combine the data from DUNE and Hyper-K. In case of no-show, we place the expected upper bounds on these CPT-violating and CPT-conserving LIV parameters at 95% C.L. using the standalone DUNE, Hyper-K, and their combination. We observe that due to its access to a longer baseline and multi-GeV neutrinos, DUNE has a better reach in probing all these LIV parameters as compared to Hyper-K. Since the terms containing the CPT-conserving LIV parameters are proportional to neutrino energy in oscillation probabilities, Hyper-K is almost insensitive to the CPT-conserving LIV parameters because it mostly deals with sub-GeV neutrinos.