Handling of internal inconsistency OLAP - Based lock table using Message Oriented Middleware in near real time data warehousing

Abstract

Overlap between data warehouse update and selection for OLAP operation in near real time data warehousing causing OLAP internal inconsistency. OLAP internal inconsistency is an inconsistent result condition from two OLAP queries that should give the same result. Some solutions for this problem have been developed, but overlap is still occurred. Space allocation within data warehouse is also required to make these solutions work. However, saving space has been an issue on data warehouse management. Thus, using space within data warehouse to handle OLAP internal inconsistency should be prevented. This paper propose a mechanism to handle OLAP internal inconsistency that prevent overlap condition between updating and selecting process without needed space within data warehouse. This mechanism is developed by combining lock table and Message Oriented Middleware (MOM). Lock table prevent update process in the data warehouse table that is still used by OLAP operation. It avoid overlap, thus OLAP can be done anytime with consistency result guaranteed. During data warehouse table is being locked, message queue on MOM will be used to save operational data that came from data source. It made operational process ongoing and OLAP internal inconsistency can be handled without use space within data warehouse.