Small adhesive particles with non-spherical shapes are common in natural and industrial processes. However, it is challenging to accurately simulate the dynamic behaviors of non-spherical particulate systems, not only due to the complex local geometry at the contact region but also to the non-linear coupling between the van der Waals adhesion and the elastic deformation. In this paper, we develop a discrete element method (DEM) framework for small non-spherical particles. Particularly, we present a simple algorithm for solving the implicit equations of the dimensionless generalized JKR model, to accurately resolve the local surface geometry at the contact region and the strong coupling between the elastic deformation and the surface adhesion. New explicit expressions are established for the pull-off force, overlap and minor-to-major ratio of the contact ellipse, to naturally capture the pull-off point upon collision. Then the actual contact parameters including the contact radius, curvatures and overlap are used to modify the interparticle interactions, including the normal elastic-adhesive-dissipative force and sliding-rolling-twisting resistances. Finally, the framework is quantitatively validated by four random packing problems, including adhesive spheres, ellipsoids, spherocylinders and dimers, and the representative non-adhesive ellipsoids. Both the microscopic and macroscopic properties of packings agree well with a large number of classic theories, experiments and simulations, showing the satisfactory accuracy and effectiveness. The newly developed adhesive DEM framework has the full capability to dynamically simulate the collision-related behaviors of complex shaped particles in the presence of van der Waals adhesion and frictional forces.