Implementation and Performance Measuring of Erasure Coding of Distributed File System 


Vol. 41,  No. 11, pp. 1515-1527, Nov.  2016


PDF
  Abstract

With the growth of big data, machine learning, and cloud computing, the importance of storage that can store large amounts of unstructured data is growing recently. So the commodity hardware based distributed file systems such as MAHA-FS, GlusterFS, and Ceph file system have received a lot of attention because of their scale-out and low-cost property. For the data fault tolerance, most of these file systems uses replication in the beginning. But as storage size is growing to tens or hundreds of petabytes, the low space efficiency of the replication has been considered as a problem. This paper applied erasure coding data fault tolerance policy to MAHA-FS for high space efficiency and introduces VDelta technique to solve data consistency problem. In this paper, we compares the performance of two file systems, MAHA-FS and GlusterFS. They have different IO processing architecture, the former is server centric and the latter is client centric architecture. We found the erasure coding performance of MAHA-FS is better than GlusterFS.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

C. Kim, Y. Kim, D. Kim, H. Kim, Y. Kim, D. Seo, "Implementation and Performance Measuring of Erasure Coding of Distributed File System," The Journal of Korean Institute of Communications and Information Sciences, vol. 41, no. 11, pp. 1515-1527, 2016. DOI: .

[ACM Style]

Cheiyol Kim, Youngchul Kim, Dongoh Kim, Hongyeon Kim, Youngkyun Kim, and Daewha Seo. 2016. Implementation and Performance Measuring of Erasure Coding of Distributed File System. The Journal of Korean Institute of Communications and Information Sciences, 41, 11, (2016), 1515-1527. DOI: .

[KICS Style]

Cheiyol Kim, Youngchul Kim, Dongoh Kim, Hongyeon Kim, Youngkyun Kim, Daewha Seo, "Implementation and Performance Measuring of Erasure Coding of Distributed File System," The Journal of Korean Institute of Communications and Information Sciences, vol. 41, no. 11, pp. 1515-1527, 11. 2016.

Search
(IN TITLE, AUTHOR, ABSTRACT,KEYWORDS)

Advanced Search ▼

POPULAR KEYWORDS
(TOP 10 KEYWORDS)

Recent Publications
(LAST 3 YEARS)






pISSN : 1226 - 4717
eISSN : 2287 - 3880