Journal of Commercial Biotechnology | VOL. 26

Heterogeneous data mining algorithm of Internet of things based on Spark of biotech and artificial intelligence architecture

Publication Date Jul 18, 2022


Due to the limitation of memory, heterogeneous data mining algorithm of Internet of things takes too long to process large-scale data of biotech companies. This paper proposes a heterogeneous data mining algorithm for Internet of things based on Spark artificial intelligence architecture. The heterogeneous data is abstracted into the characteristic value of the unified dimension related to the target task, the attribute is established and the preprocessing result is output. A distributed parallel computing framework is established by using Spark artificial intelligence architecture, and the preprocessed data is distributed to different execution points. The data of each execution point is converted into bit matrix to calculate the attribute association degree, and the data is partitioned according to the association result. According to association rules of biotech companies, local and global frequent pattern trees are generated to complete heterogeneous data mining. The experimental results show that the execution time of the heterogeneous data mining algorithm designed in this paper is 1892s, which is 1147s, 1991s and 624s less than HUIM-ACO algorithm, FP-Growth algorithm and ENFP-Growth algorithm, respectively. The algorithm designed in this paper can effectively shorten data processing time and improve the execution efficiency.


Algorithm For Internet Of Things Heterogeneous Data Mining Artificial Intelligence Architecture FP-Growth Algorithm Execution Point Internet Of Things Execution Time Of Algorithm Preprocessed Data Heterogeneous Data Global Trees

Round-ups are the summaries of handpicked papers around trending topics published every week. These would enable you to scan through a collection of papers and decide if the paper is relevant to you before actually investing time into reading it.

Climate change Research Articles published between Sep 12, 2022 to Sep 18, 2022

R DiscoverySep 19, 2022
R DiscoveryArticles Included:  5

Rainfall projections from the Coupled Model Intercomparison Project (CMIP) models are strongly tied to projected sea surface temperature (SST) spatial...

Read More

Coronavirus Pandemic

You can also read COVID related content on R COVID-19

R ProductsCOVID-19


Creating the world’s largest AI-driven & human-curated collection of research, news, expert recommendations and educational resources on COVID-19

COVID-19 Dashboard

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on “as is” basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The Copyright Law.