Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-dev@hadoop.apache.org
Date: Fri, 29 May 2015 15:01:18 +0000 (UTC)
From: "Daryn Sharp (JIRA)" <jira@apache.org>
To: hdfs-dev@hadoop.apache.org
Message-ID: <JIRA.12833818.1432911640000.67263.1432911678026@Atlassian.JIRA>
In-Reply-To: <JIRA.12833818.1432911640000@Atlassian.JIRA>
References: <JIRA.12833818.1432911640000@Atlassian.JIRA>
 <JIRA.12833818.1432911640868@arcas>
Subject: [jira] [Created] (HDFS-8498) Blocks can be committed with wrong
 size
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Daryn Sharp created HDFS-8498:
---------------------------------

             Summary: Blocks can be committed with wrong size
                 Key: HDFS-8498
                 URL: https://issues.apache.org/jira/browse/HDFS-8498
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: namenode
    Affects Versions: 2.5.0
            Reporter: Daryn Sharp
            Assignee: Daryn Sharp
            Priority: Critical


When an IBR for a UC block arrives, the NN updates the expected location's block and replica state _only_ if it's on an unexpected storage for an expected DN.  If it's for an expected storage, only the genstamp is updated.  When the block is committed, and the expected locations are verified, only the genstamp is checked.  The size is not checked but it wasn't updated in the expected locations anyway.

A faulty client may misreport the size when committing the block.  The block is effectively corrupted.  If the NN issues replications, the received IBR is considered corrupt, the NN invalidates the block, immediately issues another replication.  The NN eventually realizes all the original replicas are corrupt after full BRs are received from the original DNs.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)