hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background
Date Wed, 10 Sep 2014 23:44:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129374#comment-14129374
] 

Colin Patrick McCabe commented on HDFS-6867:
--------------------------------------------

No, unfortunately it tests ALL files, regardless of how silly :)

No harm done, though.

The new design doc looks good.  I think having recovery done by the streamer thread will prove
to be easier and more maintainable in the future, so good choice there.

> For DFSOutputStream, do pipeline recovery for a single block in the background
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-6867
>                 URL: https://issues.apache.org/jira/browse/HDFS-6867
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs-client
>            Reporter: Colin Patrick McCabe
>            Assignee: Zhe Zhang
>         Attachments: HDFS-6867-20140827-2.patch, HDFS-6867-20140827-3.patch, HDFS-6867-20140827.patch,
HDFS-6867-20140828-1.patch, HDFS-6867-20140828-2.patch, HDFS-6867-design-20140820.pdf, HDFS-6867-design-20140821.pdf,
HDFS-6867-design-20140822.pdf, HDFS-6867-design-20140827.pdf, HDFS-6867-design-20140910.pdf
>
>
> For DFSOutputStream, we should be able to do pipeline recovery in the background, while
the user is continuing to write to the file.  This is especially useful for long-lived clients
that write to an HDFS file slowly. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message