Abstract
Aiming at the demand of real-time massive data processing of Intelligent Agriculture in Jilin Province, this paper studies the big data processing of Intelligent Agriculture in Jilin Province based on Spark platform by acquiring real-time data through monitoring platform. This study first conducted the performance comparison experiment of Hadoop and Spark data processing platform, then used the Spark distributed cluster computing platform, real-time processing the big data of monitoring area. The experimental results show that the Spark platform speeds up 11.4 times faster than the Hadoop platform in the case of 100 million data sizes; and based on the Spark platform for real-time processing of big data intelligent agricultural monitoring network, not only provides memory calculations to reduce IO overhead, but also the results are faster and more accurate. The research results provide strong support for the implementation of precision agriculture technology in intelligent agriculture.
Highlights
China is a large agricultural country,facing the ever changing agricultural production technology,Especially the introduction of remote sensing, geographic information technology, precision agriculture and expert system in the field of farmland management
Integration and demonstration of corn precise operation technology based on Internet of things " demonstration area at Nong'an county in real time through the intelligent agricultural monitoring platform,proposes the Spark distributed cluster computing platform
Through accessing the soil air temperature and humidity data from intelligent monitoring network of the National Spark Program " Integration and demonstration of corn precise operation technology based on Internet of things " demonstration area at Nong'an county in real time through the intelligent agricultural monitoring platform, research on Spark platform for big data processing of Intelligent Agriculture in Jilin province found that: (1)Spark and Hadoop platform efficiency comparison test results show that,the Spark platform has the advantage of reducing IO overhead with its memory computing,Hadoop is more suitable for dealing with real time big data of intelligent agriculture monitoring network in Jilin province
Summary
China is a large agricultural country,facing the ever changing agricultural production technology,Especially the introduction of remote sensing, geographic information technology, precision agriculture and expert system in the field of farmland management. This condition leads to the original variety of agricultural ecosystems turning more complex. It is urgent to use a method to classify and extract large amounts of data to find out the correlation and underlying pattern between them[1],establish the platform for analysis and preprocessing data, monitor agricultural production process, and combine with data mining technology to obtain real-time information,formulate appropriate coordination measures,and realize the precise operation of the farmland management area.Improving the quality of agricultural products under the premise of sustainable development provides a good development environment and material basis for other areas and even the whole national economic development[2]
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
