Abstract

Microservices and Big Data are renowned hot topics in computer science that have gained a lot of hype. While the use of microservices is an approach that is used in modern software development to increase flexibility, Big Data allows organizations to turn today’s information deluge into valuable insights. Many of those Big Data architectures have rather monolithic elements. However, a new trend arises in which monolithic architectures are replaced with more modularized ones, such as microservices. This transformation provides the benefits from microservices such as modularity, evolutionary design and extensibility while maintaining the old monolithic product’s functionality. This is also valid for Big Data architectures. To facilitate the success of this transformation, there are certain beneficial factors. In this paper, those aspects will be presented and the transformation of an exemplary Big Data architecture with somewhat monolithic elements into a microservice favoured one is outlined.

Highlights

  • A continuous growth of the overall amount of data that is created, captured and analyzed heavily affects today’s infrastructures as a whole [1]

  • We will compare the success factors presented in Section 4 with the architecture presented

  • A service compares its data with the data of the data service. This fulfills the point of data consistency and the first success factor

Read more

Summary

Introduction

A continuous growth of the overall amount of data that is created, captured and analyzed heavily affects today’s infrastructures as a whole [1]. Implementing the respective applications is still a challenging task [4] Contributing to this problem, the newly implemented algorithms and solutions might evolve over time, rendering the effort pointless, if the Big Data architecture is not adapted . This results in a rising demand for designs, which consist of building blocks that can be modified and replaced independently from each other, contrasting isolated implementations and applications [5]. At first, t he c oncepts o f m icroservices a nd B ig D ata a re described This is followed by a look at what research has already done in the area of microservices in Big Data. A conclusion is given, highlighting potentially beneficial directions for future research endeavors

Background
Big Data
Monolithic Architectures
Microservices
Microservices in Big Data
Success Factors of Microservices in Big Data
Example Transformation
Exemplary Big Data Architecture
Transformation
Advantages and Challenges
Evaluation of the Transformation in View of the Success Factors
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call