hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception
Date Wed, 08 Oct 2014 18:07:35 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163889#comment-14163889
] 

Colin Patrick McCabe commented on HDFS-7199:
--------------------------------------------

bq. The bug in the case we encountered was bad hardware. The JVM was glitching out and happened
to generate a java.lang.VerifyError in the DataStreamer thread.

Thanks for that background.  It sounds like we are not at fault for once for generating the
original exception :)

> DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception
> ---------------------------------------------------------------------------------------
>
>                 Key: HDFS-7199
>                 URL: https://issues.apache.org/jira/browse/HDFS-7199
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs-client
>    Affects Versions: 2.5.0
>            Reporter: Jason Lowe
>            Assignee: Chen He
>            Priority: Critical
>
> If the DataStreamer thread encounters a non-I/O exception then it closes the output stream
but does not set lastException.  When the client later calls close on the output stream then
it will see the stream is already closed with lastException == null, mistakently think this
is a redundant close call, and fail to report any error to the client.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message