hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6325) Append should fail if the last block has insufficient number of replicas
Date Fri, 16 May 2014 11:16:10 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13999576#comment-13999576

Hadoop QA commented on HDFS-6325:

{color:green}+1 overall{color}.  Here are the results of testing the latest attachment 
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs.

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6913//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6913//console

This message is automatically generated.

> Append should fail if the last block has insufficient number of replicas
> ------------------------------------------------------------------------
>                 Key: HDFS-6325
>                 URL: https://issues.apache.org/jira/browse/HDFS-6325
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 2.2.0
>            Reporter: Konstantin Shvachko
>            Assignee: Keith Pak
>         Attachments: HDFS-6325.patch, HDFS-6325.patch, HDFS-6325.patch, HDFS-6325.patch,
HDFS-6325_test.patch, appendTest.patch
> Currently append() succeeds on a file with the last block that has no replicas. But the
subsequent updatePipeline() fails as there are no replicas with the exception "Unable to retrieve
blocks locations for last block". This leaves the file unclosed, and others can not do anything
with it until its lease expires.
> The solution is to check replicas of the last block on the NameNode and fail during append()
rather than during updatePipeline().
> How many replicas should be present before NN allows to append? I see two options:
> # min-replication: allow append if the last block is minimally replicated (1 by default)
> # full-replication: allow append if the last block is fully replicated (3 by default)

This message was sent by Atlassian JIRA

View raw message