hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Walter Su (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8669) Erasure Coding: handle missing internal block locations in DFSStripedInputStream
Date Mon, 13 Jul 2015 08:39:04 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Walter Su updated HDFS-8669:
----------------------------
    Attachment: HDFS-8669-HDFS-7285.001.patch

LGTM. +1. Upload patch for Jing Zhao to trigger Jenkins.

> Erasure Coding: handle missing internal block locations in DFSStripedInputStream
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-8669
>                 URL: https://issues.apache.org/jira/browse/HDFS-8669
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-8669-HDFS-7285.001.patch, HDFS-8669.000.patch, HDFS-8669.001.patch
>
>
> Currently DFSStripedInputStream assumes we always have complete internal block location
information, i.e., we can always get all the DataNodes for a striped block group. In a lot
of scenarios the client cannot get complete block location info, e.g., some internal blocks
are missing and the NameNode has not finished the recovery yet. We should add functionality
to handle missing block locations in DFSStripedInputStream.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message