Online Integration of SQL and No-SQL Databases using RestAPIs: A Case on 2 furniture e-Commerce Sites

Abstract

Database technology is one of the key elements in every internet-based system. As technology develops and the need for fast and large data exchange arises, a type of NoSQL or unstructured database emerges. SQL and relational databases have table forms, while NoSQL has a format of document-oriented stores. Integration issue came as a challenge when the two different databases were used on the same software. The challenge is increasingly complicated when the database used becomes the resource of online websites. In this study, we present a case which based on 2 online e-Commerce furniture websites that. These both online websites will merge their product data into 1 new database. This research combines two different databases using Web services to retrieve data in each database and a synchronization system for the process of checking and storing data into a new database. All merging components are stored on cloud storage services. Every batching process in the synchronization system is done online and automatically uses Cron. This research provides the results of data integration testing on web services and measurement of the synchronization system execution time. After testing 2 web services used, all passed the data integration test. Then measurements are made on the synchronization system by looking at the displayed execution time. The results of measurements using 100 to 1000 data and different conditions, the execution time obtained from 4 to 5 seconds for each data in the measurement increases to 500 data. The results of this study indicate that the integration of data from 2 different databases using web services and synchronization systems is tolerable and suitable for the amount of data under 10000 data with the condition of the database already filled.