hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "nkeywal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing
Date Wed, 10 Oct 2012 14:13:03 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13473246#comment-13473246
] 

nkeywal commented on HDFS-3912:
-------------------------------

Hi,

I'm ok with the new logic for the warning, 3 times the heartbeat is a quite common rule. I
would like to test the patch on branch 1.1, it defers quite a lot from branch 3.0 regarding
to block placement policy and so on. Jing, do you want to do the port? If you don't have time
I will do it. I've already tested HBase trunk with branch 1.1 without the patch, it works
(but with write errors as it is sent on the dead box).

Thanks!

Nicolas
                
> Detecting and avoiding stale datanodes for writing
> --------------------------------------------------
>
>                 Key: HDFS-3912
>                 URL: https://issues.apache.org/jira/browse/HDFS-3912
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>    Affects Versions: 3.0.0
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-3912.001.patch, HDFS-3912.002.patch, HDFS-3912.003.patch, HDFS-3912.004.patch,
HDFS-3912.005.patch, HDFS-3912.006.patch, HDFS-3912.007.patch, HDFS-3912.008.patch, HDFS-3912.009.patch
>
>
> 1. Make stale timeout adaptive to the number of nodes marked stale in the cluster.
> 2. Consider having a separate configuration for write skipping the stale nodes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message