Abstract

Failure in the process of loading data from the Online Transactional Processing(OLTP) system to the Normalized Data Store (NDS) database can occur. This caused by a disruption in the network so that the OLTP system is unable to save data to the OLTP and NDS databases. Backup and synchronization data scenarios are needed to maintain data consistency and data availability. In this research, the process of data backup and synchronization is done by providing an identity column for the table in the OLTP database. An identity column is used to give status data, value '0' if the inserting process fails, and value '1' if successful. Data backup is done by storing temporary data into a CSV file format, then the CSV file is read, and an insert process is carried out into the OLTP database. After the insertion process into the OLTP database is successful, it continues with the synchronization process between the OLTP database and the NDS. Data synchronization between OLTP and NDS databases is done by checking the value of the Identity Column in each table in the OLTP database.

Highlights

  • Data processing using information systems provides benefits, including speed up processing time due to automation

  • The test is carried out using a Customer Relationship Management System (CRM) Online Transaction Processing (OLTP) simulation application that is useful for recording any customer complaints telecommunications services

  • Data backup is done by storing temporary data in a file in the format of Comma Separated Values (CSV), the CSV file is read, and the process is inserted into the OLTP database

Read more

Summary

Introduction

Data processing using information systems provides benefits, including speed up processing time due to automation. There are several ETL approaches to realizing real-time data warehouse between processing data that only undergoes updating or known as the Change Data Capture (CDC) concept [1][2][5][10][11][16][18]. Another approach is to accelerate the frequency of data extraction [2][11][12][15][19]. Both approaches aim to reduce the data processing time lag so that real-time data warehouse is realized

Methods
Results
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.