hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1923) Intermittent recurring failure in TestFiDataTransferProtocol2.pipeline_Fi_29
Date Sun, 05 Jun 2011 23:24:51 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044646#comment-13044646
] 

Todd Lipcon commented on HDFS-1923:
-----------------------------------

Hey Nicholas. Those semantics are kind of surprising to me. As I remember the motivation for
the feature, the idea is to reduce the likelihood that a long-running pipeline completely
fails. Given that, it seems preferable to continue with 2 or 1 replicas in the pipeline if
there are no more nodes left in the cluster, rather than fail if it can't recruit a new one.

That is to say, if you had a 4-node cluster with the feature enabled, it's actually going
to have pipeline failures more often with the feature enabled than with the feature disabled,
statistically speaking.

That said, that's a separate question than this patch. So, if you believe the feature is working
as designed, then +1.

> Intermittent recurring failure in TestFiDataTransferProtocol2.pipeline_Fi_29
> ----------------------------------------------------------------------------
>
>                 Key: HDFS-1923
>                 URL: https://issues.apache.org/jira/browse/HDFS-1923
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: test
>            Reporter: Matt Foley
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: h1923_20110527.patch
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message