hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor
Date Sun, 17 Sep 2017 16:03:02 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169328#comment-16169328
] 

Yongjun Zhang commented on HDFS-11799:
--------------------------------------

Thanks for the revised patch [~brahmareddy]. Patch 006 looks good except for two nits:

1. suggest to change  HdfsClientConfigKeys.BlockWrite.ReplaceDatanodeOnFailure.REPLICATION
to HdfsClientConfigKeys.BlockWrite.ReplaceDatanodeOnFailure.MIN_REPLICATION

2.  replace the string  'dfs.client.block.write.replace-datanode-on-failure.min.replication'
in the comment with  'HdfsClientConfigKeys.BlockWrite.ReplaceDatanodeOnFailure.MIN_REPLICATION'

  


> Introduce a config to allow setting up write pipeline with fewer nodes than replication
factor
> ----------------------------------------------------------------------------------------------
>
>                 Key: HDFS-11799
>                 URL: https://issues.apache.org/jira/browse/HDFS-11799
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Yongjun Zhang
>            Assignee: Brahma Reddy Battula
>         Attachments: HDFS-11799-002.patch, HDFS-11799-003.patch, HDFS-11799-004.patch,
HDFS-11799-005.patch, HDFS-11799-006.patch, HDFS-11799.patch
>
>
> During pipeline recovery, if not enough DNs can be found, if 
> dfs.client.block.write.replace-datanode-on-failure.best-effort
> is enabled, we let the pipeline to continue, even if there is a single DN.
> Similarly, when we create the write pipeline initially, if for some reason we can't find
enough DNs, we can have a similar config to enable writing with a single DN.
> More study will be done.
>  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message