hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11284) [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.
Date Sun, 01 Jan 2017 05:03:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15790557#comment-15790557
] 

Uma Maheswara Rao G commented on HDFS-11284:
--------------------------------------------

Thanks for the details.
So, except first issue, this JIRA can not be a blocker for HDFS-11150. SO, I suggest, fix
#1 as part of HDFS-11150 and proceed as that is more important task. #3 is special condition
where you made file to have under replicated. #3 alone you can discuss and fix here.

For #3, If I understand the issue correctly, the thing is that we can satisfy the the policy
for existing replicas. In the case of under replicated blocks, NN will try to replicate the
block later and while doing, it would choose the block location as per the new policy set
at NN. Can you confirm that it is not happening?

> [SPS]: Avoid running SPS under safemode and fix issues in target node choosing.
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-11284
>                 URL: https://issues.apache.org/jira/browse/HDFS-11284
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode, namenode
>            Reporter: Yuanbo Liu
>            Assignee: Yuanbo Liu
>
> Recently I've found in some conditions, SPS is not stable:
> * SPS runs under safe mode.
> * There're some overlap nodes in the chosen target nodes.
> * The real replication number of block doesn't match the replication factor. For example,
the real replication is 2 while the replication factor is 3.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message