Abstract

 
 
 Amount of data in the web is growing rapidly from day to day and for normal human it's hard to realize what is actually happening in the world at the current moment, so it is required to have a system which allows collect and analyze huge amount of variety data from different web resources. The system should be able to process a lot of data fast and be capable to store all collected data for future processing. How to achieve this with use of lambda architecture is described in this article.
 
 
Highlights
Amount of data in the web is growing rapidly from day to day and for normal human it's hard to realize what is happening in the world at the current moment, so it is required to have a system which allows collect and analyze huge amount of variety data from different web resources
The system should be able to process a lot of data fast and be capable to store all collected data for future processing
How to achieve this with use of lambda architecture is described in this article
Summary
Amount of data in the web is growing rapidly from day to day and for normal human it's hard to realize what is happening in the world at the current moment, so it is required to have a system which allows collect and analyze huge amount of variety data from different web resources. Можливість архівування даних для подальшої обробки, або зміни існуючої. Система повинна справлятися з дуже великим об’ємом даних, і для досягнення цього повинно бути достатньо просто добавити більше машин. Другий же це обробка мікро-пакетів даних, що поступають постійно з частотою від декількох мілісекунд. Лямбда архітектура орієнтована на постійно вхідні дані із якихось ресурсів, тому вона ідеально підходить для web mining.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.