hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1606) Provide a stronger data guarantee in the write pipeline
Date Mon, 31 Jan 2011 23:41:29 GMT
Provide a stronger data guarantee in the write pipeline

                 Key: HDFS-1606
                 URL: https://issues.apache.org/jira/browse/HDFS-1606
             Project: Hadoop HDFS
          Issue Type: New Feature
          Components: data-node, hdfs client
            Reporter: Tsz Wo (Nicholas), SZE

In the current design, if there is a datanode/network failures in the write pipeline, DFSClient
will try to remove the failed datanode from the pipeline and then continue writing with the
remaining datanodes.  As a result, the number of datanodes in the pipeline is decreased. 
Unfortunately, it is possible that DFSClient may incorrectly remove a healthy datanode but
leave the failed datanode in the pipeline because failure detection may not be accurate under
erroneous conditions.

We propose to add a new mechanism for adding new datanodes to the pipeline in order to provide
a stronger data guarantee.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message