Transient flows of viscoplastic fluids have very peculiar characteristics. The startup and cessation flows of viscoplastic materials have been subject to many theoretical and numerical investigations. The most challenging aspect of numerical solutions of viscoplastic fluids is the viscosity singularity during the transition from yielded to unyielded material. Hence, the proper representation of yield surfaces is the most critical aspect of numerical methods in viscoplastic fluid flow. In the present work, we use a lattice Boltzmann scheme to solve an ideal Bingham fluid’s startup and cessation flows. This numerical scheme advantage is that can represent infinite viscosity without noticeable numerical instabilities, producing yield surfaces with more accuracy and quality. Theoretical solutions for the startup flow are available in the literature. However, it is unclear which is more accurate and what their validity ranges are. Nonetheless, these solutions served as a reference for the present simulations. The overall aspect of the numerical solutions agreed with the theoretical models. The cessation flow of the Bingham fluid was also simulated. Unlike a Newtonian fluid, this type of flow is known to have a finite period until cessation. The simulations correctly reproduced this behavior. The transient yield surfaces matched very well with augmented Lagrangian solutions.