Abstract

The online business era causes the form of transactions to occur so quickly that the information stored in the data warehouse becomes invalid. Companies are required to have a strong system, which is a system that is real time in order to be able to perform data loading into the media repository that resides on different hosts in the near-real time. Data Warehouse is used as a media repository of data that has the nature of subject-oriented, integrated, time-variant, and is fixed. Data Warehouse can be built into real time management with the advantages possessed and utilize Change Data Capture. Change Data Capture (CDC) is a technique that can be used as problem solution to build real time data warehousing (RTDW). The binary log approach in change data capture is made to record any data manipulation activity that occurs at the OLTP level and is managed back before being stored into the Data Warehouse (loading process). This can improve the quality of data management so that the creation of the right information, because the information available is always updated. Testing shows that Binary Log approach in Change Data Capture (BinlogCDC) is able to generate real time data management, valid current information, dynamic communication between systems, and data management without losing any information from data manipulation.

Highlights

  • Proses log scanning atau catatan yang ada pada Binary Log digunakan untuk menjadi acuan dalam membangun Change Data Capture (CDC) [4]

  • BinlogCDC menjadikan informasi yang tersedia dalam data warehouse sebagai tujuan data, selalu diperbarui setiap saat terjadinya manipulasi atau perubahan pada on-line transaction processing (OLTP) sebagai sumber data sehingga informasi terkini yang tersimpan menjadi valid

Read more

Summary

Introduction

Manipulasi data menjadi pemicu sistem untuk mengambil informasi yang terkandung di dalam binary log dan melakukan proses pengolahan isi dari binary log. Alur Proses Loading Data Informasi dari hasil pengolahan akhir tersimpan secara sementara dalam sebuah tabel staging dan dihapus kembali ketika proses loading telah selesai dilakukan seperti yang terlihat pada Gambar 5. Informasi inilah yang dimanfaatkan dalam membangun sebuah sistem change data capture dengan pendekatan binary log yang ditunjukkan pada Gambar 7.

Results
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.