Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 318D5107FF for ; Mon, 21 Oct 2013 22:03:47 +0000 (UTC) Received: (qmail 14432 invoked by uid 500); 21 Oct 2013 22:03:08 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 14372 invoked by uid 500); 21 Oct 2013 22:03:03 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 14109 invoked by uid 99); 21 Oct 2013 22:02:45 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Oct 2013 22:02:45 +0000 Date: Mon, 21 Oct 2013 22:02:45 +0000 (UTC) From: "Arpit Agarwal (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-5390) Incremental block reports should be sent per storage directory MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5390: -------------------------------- Attachment: h5390.03.patch Fix BPServiceActor to track incremental BR state per storage. Send one incremental BR for each storage to the Namenode. Ideally we'd like to send a single message with incremental BR for all storages but it cannot be done without an incompatible change to the protocol. > Incremental block reports should be sent per storage directory > -------------------------------------------------------------- > > Key: HDFS-5390 > URL: https://issues.apache.org/jira/browse/HDFS-5390 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: datanode > Affects Versions: Heterogeneous Storage (HDFS-2832) > Reporter: Arpit Agarwal > Assignee: Arpit Agarwal > Attachments: h5390.03.patch > > > Incremental block reports should be sent per storage directory since the NameNode now expects all block reports to be sent per storage. Currently the Datanode tracks pending incremental block reports for all storages in a single queue. > This is a continuation of the work started by HDFS-5134 and HDFS-4988 to split block processing per storage directory. -- This message was sent by Atlassian JIRA (v6.1#6144)