Numerical simulations of flows with dilute disperse phase play an important role in a wide range of industrial applications. The most commonly used technique for solving such problems is the Eulerian-Lagrangian approach, in which individual particles are tracked inside the domain. However, the use of sliding and moving mesh in complex engineering applications poses more challenges for the parallelization of the Eulerian-Lagrangian method in the two-way coupling. In this context, this manuscript presents the parallel algorithm for tracking Lagrangian particles crossing sliding non-conformal interfaces in a mixed Eulerian-Lagrangian CFD algorithm, which is based on a parallel supermesh method introduced recently for the handling of sliding mesh in large-scale parallel computing (Y. Xiao and P.J. Ming, Jour. Computat. Phys., 2022). In the proposed parallel algorithm, critical problems such as geometric calculation for particles across non-conformal mesh interfaces and the dynamic communication for particle data can be handled based on the one-to-one addressing constructed by the supermesh method introduced in the author's previous work. Further, a robust and easy-to-implement algorithm is also provided for particle communication caused by mesh moving. All methodologies are integrated and implemented for parallel computation obtaining good robustness and consistency. Specific examples are solved to examine the performance of this parallel strategy when applied to practical engineering problems.