The computer vision researchers concentrated on the automation of the surveillance system. Many datasets suited for diverse applications have been proposed by research in this subject. in a number of different domains of application Human action recognition may be used effectively, which has the potential to improve many facets of daily life.These contain, among other things, preventing violent act and detecting crimes such as murder, stealing, and property damage, as well as predicting pedestrian activity in traffic. And this study addresses the properties of public datasets used for Human Action Recognition. Researchers develop these distinct anomaly datasets as a result of the availability of security cameras installed in various areas. For researchers to comprehend and develop in this field, It is required to review anomaly detection video datasets. Therefor This study presents a survey for video surveillance activity recognition.