hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9180) Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers
Date Sat, 03 Oct 2015 00:17:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941986#comment-14941986
] 

Jing Zhao commented on HDFS-9180:
---------------------------------

{{TestDFSStripedOutputStreamWithFailure#testDatanodeFailureRandomLength}} failed with length
{{1835007}}. I've run with the same length locally 150 times but could not reproduce the failure.


I kicked the Jenkins again. If we all agree the fixes here are valid maybe we can consider
commit them first and keep fixing remaining issues in separate jiras.

> Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers
> ---------------------------------------------------------------------------------------
>
>                 Key: HDFS-9180
>                 URL: https://issues.apache.org/jira/browse/HDFS-9180
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding
>    Affects Versions: 3.0.0
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HDFS-9180.000.patch, HDFS-9180.001.patch, HDFS-9180.002.patch
>
>
> This is a TODO in HDFS-9040: based on the failures all the striped data streamers hit,
the DFSStripedOutputStream should keep a record of all the DataNodes that should be excluded.
> This jira will also fix several bugs in the DFSStripedOutputStream. Will provide more
details in the comment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message