Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2E10810F2C for ; Mon, 20 Apr 2015 00:24:59 +0000 (UTC) Received: (qmail 8265 invoked by uid 500); 20 Apr 2015 00:24:59 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 8205 invoked by uid 500); 20 Apr 2015 00:24:59 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 8193 invoked by uid 99); 20 Apr 2015 00:24:58 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Apr 2015 00:24:58 +0000 Date: Mon, 20 Apr 2015 00:24:58 +0000 (UTC) From: "Kai Zheng (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502185#comment-14502185 ] Kai Zheng commented on HDFS-7678: --------------------------------- Hi [~zhz], a very good question! You just reminded me of something planned to do long before, :). I opened HADOOP-11847 to address it. I will make my answer to your question as part of the API (in codes comment). Thanks! > Erasure coding: DFSInputStream with decode functionality > -------------------------------------------------------- > > Key: HDFS-7678 > URL: https://issues.apache.org/jira/browse/HDFS-7678 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Li Bo > Assignee: Zhe Zhang > Attachments: BlockGroupReader.patch, HDFS-7678.000.patch > > > A block group reader will read data from BlockGroup no matter in striping layout or contiguous layout. The corrupt blocks can be known before reading(told by namenode), or just be found during reading. The block group reader needs to do decoding work when some blocks are found corrupt. -- This message was sent by Atlassian JIRA (v6.3.4#6332)