Abstract
With the arrival of large data age, distributed database HBase becomes an important tool for storing data in massive data age. The normal operation of HBase database is an important guarantee to ensure the security of data storage. Therefore designing a reasonable HBase monitoring system is of great significance in practice. In this article, we introduce the solution, which contains the performance monitoring and fault alarm function module, to meet a certain operator’s demand of HBase monitoring database in their actual production projects. We designed a monitoring system which consists of a flexible and extensible monitoring agent, a monitoring server based on SSM architecture, and a concise monitoring display layer. Moreover, in order to deal with the problem that pages renders too slow in the actual operation process, we present a solution: reducing the SQL query. It has been proved that reducing SQL query can effectively improve system performance and user experience. The system work well in monitoring the status of HBase database, flexibly extending the monitoring index, and issuing a warning when a fault occurs, so that it is able to improve the working efficiency of the administrator, and ensure the smooth operation of the project.
Highlights
With the development of technology, nowadays the companies are producing rich types of data at an unprecedented speed and scale
Monitoring database becomes important means to assure the safety of data storage and smooth operation of project
Given the low loading speed in the process of practical operation, we work out a solution to reduce the SQL query, providing a reference for related researchers
Summary
With the development of technology, nowadays the companies are producing rich types of data at an unprecedented speed and scale. HBase , which disperses the data originally stored in a centralized database to multiple data storage node, have faster data access,greater scalability, and higher concurrent traffic. It can better meet current needs for data storage. Artificial monitoring tends to be delayed in detection of malfunction.It’s susceptible to data loss, abnormal operation of project and other problems.Database error or stop working even for a short period of time may cause huge losses.In addition, this approach requires a lot of labor,which is inability to cope with the increased management difficulty and workload of the database.The other method is software monitoring.The main open source. By means of modulating monitoring indicators of different type, this system can flexibly adding monitoring indicators by configuration file based on the actual needs of the project.On the other hand, It can detect alarm situation regularly and inform administrators immediately when problems occur, which can significantly improve the efficiency of management staff.Besides,Through the charts in front-end which show the performance of the latest data and historical data, managers can fully aware of the changes of database performance
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
