Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EE70917D18 for ; Tue, 7 Apr 2015 05:28:12 +0000 (UTC) Received: (qmail 90052 invoked by uid 500); 7 Apr 2015 05:28:12 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 89995 invoked by uid 500); 7 Apr 2015 05:28:12 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 89983 invoked by uid 99); 7 Apr 2015 05:28:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Apr 2015 05:28:12 +0000 Date: Tue, 7 Apr 2015 05:28:12 +0000 (UTC) From: "Jing Zhao (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482620#comment-14482620 ] Jing Zhao commented on HDFS-8059: --------------------------------- bq. Otherwise we should use other ways to get these two information, maybe again through the ECZone? Yes. We should get this information when resolving the path. Therefore if we really need to save memory in the future, we can even skip the two numbers in the INodeFile level maybe. > Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile > --------------------------------------------------------------------------------------- > > Key: HDFS-8059 > URL: https://issues.apache.org/jira/browse/HDFS-8059 > Project: Hadoop HDFS > Issue Type: Sub-task > Affects Versions: HDFS-7285 > Reporter: Yi Liu > Assignee: Yi Liu > Attachments: HDFS-8059.001.patch > > > Move {{dataBlockNum}} and {{parityBlockNum}} from BlockInfoStriped to INodeFile, and store them in {{FileWithStripedBlocksFeature}}. > Ideally these two nums are the same for all striped blocks in a file, and store them in BlockInfoStriped will waste NN memory. -- This message was sent by Atlassian JIRA (v6.3.4#6332)