Design and Implementation of Digitization Resource Sharing System Based on Hadoop Platform

Abstract

The basic idea of Hadoop is to use multiple independently working computers to form a cluster of computers that can be stored and calculated logically, and do not require other expensive facilities to run, but integrate cheap equipment together. Hadoop technology is produced in the context of big data, to achieve the mass storage of big data, the most prominent advantage is the cost advantage. Based on Hadoop architecture, this paper designs the LZW compression algorithm for improving the storage efficiency of teaching resources, including the algorithm principle and algorithm flow. The system functions of resource collection, storage, management, migration and retrieval are designed. and designed the function module of each system. The function modules of the system form a whole system through parameter transfer, which has low coupling property. The research results assist the construction of an integrated sharing system of storage, management, transfer and retrieval of teaching resources to meet the demands of teaching resource sharing in the era of big data.