Abstract

The Information Dispersal Algorithm (IDA) has become a key component in several fault-tolerant massive storage systems. From a theoretical point of view, it is a linear transformation over a finite field on the vectors that make up a given file. Direct transformation adds redundancy, splitting the initial file into a new set of files called dispersals. The inverse transformation recovers the original file from a subset of dispersals. This piece of research demonstrates the impact of input and output (I/O) operations on direct and inverse transformations. Different alternatives to control the exchange of elements between RAM and disk were evaluated, which is the key operation to build a vector in memory and store its entries in a file. First, the impact of the working finite field was tested; second, the impact of the use of a buffer for exchange between the RAM and the hard disk, and finally, several instances of the algorithm with which to evaluate the impact of parallelism were simultaneously deployed. The results demonstrate that the combination of these factors may have an important effect on the speed of both direct and inverse procedures.

Highlights

  • The information dispersal algorithm (IDA) [1] has drawn the attention of an increasingly large community of researchers from academia and industry alike

  • In particular, IDA offers the opportunity to build massive storage systems in which the difference between raw or gross capacity and effective capacity is reduced, while supporting the same level of fault tolerance found in other copy or replica-based systems

  • The HDD was reformatted for each family of experiments and the file system cache was emptied at the beginning of each experiment

Read more

Summary

INTRODUCTION

The information dispersal algorithm (IDA) [1] has drawn the attention of an increasingly large community of researchers from academia and industry alike. This may be due to the elegance of its approach, and to the possibilities it opens up for communications and storage applications. This study initially addressed the importance held by the order of the working finite field, but the experiments demonstrated that this offer is only a possibility to control file reading and writing operations, which have the greatest impact on the costs involved.

RELATED WORK
THE LINEAR TRANSFORMATION
EXPERIMENTS AND RESULTS
CONCLUSION

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.