Abstract
The most common problems that arise when working with big data for intelligent production are analyzed in the article. The work of recommendation systems for finding the most relevant user information was considered. The features of the singular-value decomposition (SVD) and Funk SVD algorithms for reducing the dimensionality of data and providing quick recommendations were determined. An improvement of the Funk SVD algorithm using a smaller required amount of user data for analysis was proposed. According to the results of the experiments, the proposed modification improves the speed of data processing on average by 50–70% depending on the number of users and allows spending fewer computing resources. As follows, recommendations to users are provided in a shorter period and are more relevant. The faster calculation of modified Funk SVD to exchange the optimal parameters between nodes was proposed. It was determined that execution time can be reduced on average by 75% for using ten nodes exchanging the optimal decomposition parameter compared to using one. Using Spark technology for faster calculation on average by 20% compared to Hadoop was proposed. The architecture of the IIoT system was proposed, which uses a modified Funk SVD algorithm to optimize data on edge devices and monitors the effectiveness of providing recommendations using control centers and cloud resources.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.