hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8320) Erasure coding: consolidate striping-related terminologies
Date Mon, 04 May 2015 22:05:07 GMT
Zhe Zhang created HDFS-8320:

             Summary: Erasure coding: consolidate striping-related terminologies
                 Key: HDFS-8320
                 URL: https://issues.apache.org/jira/browse/HDFS-8320
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Zhe Zhang
            Assignee: Zhe Zhang

Right now we are doing striping-based I/O in a number of places:
# Client output stream (HDFS-7889)
# Client input stream
#* pread (HDFS-7782, HDFS-7678)
#* stateful read (HDFS-8033, HDFS-8281, HDFS-8319)
# DN reconstruction (HDFS-7348)

In each place we use one or multiple of the following terminologies:
# Cell
# Stripe
# Block group
# Internal block

This JIRA aims to systematically define these terminologies in relation with each other and
in the context of the containing file. For example, a cell belong to stripe _i_ and internal
block _j_ can be indexed as {{(i, j)}} and its logical index _k_ in the file can be calculated.

With the above consolidation, hopefully we can further consolidate striping I/O codes.

This message was sent by Atlassian JIRA

View raw message