hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3770) TestFileConcurrentReader#testUnfinishedBlockCRCErrorTransferToAppend failed
Date Wed, 08 Aug 2012 03:21:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430833#comment-13430833

Todd Lipcon commented on HDFS-3770:

Basically: when the reader opens the file, the file is closed, so it's not instanceof {{ReplicaBeingWritten}}.
So, it doesn't do the special re-computation of the last checksum chunk at EOF. But, then,
after the file is open, another writer comes along and appends. Then the BlockSender doesn't
do the workaround for this race, and we end up with the same issue as described in that other
> TestFileConcurrentReader#testUnfinishedBlockCRCErrorTransferToAppend failed
> ---------------------------------------------------------------------------
>                 Key: HDFS-3770
>                 URL: https://issues.apache.org/jira/browse/HDFS-3770
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 3.0.0
>            Reporter: Eli Collins
> TestFileConcurrentReader#testUnfinishedBlockCRCErrorTransferToAppend failed on [a recent
job|https://builds.apache.org/job/PreCommit-HDFS-Build/2959]. Looks like a race in the test.
The failure is due to a ChecksumException but that's likely due to the DFSOutputstream getting
interrupted on close. Looking at the relevant code, waitForAckedSeqno is getting an InterruptedException
waiting on dataQueue, looks like there are uses of interrupt where we're not first notifying
dataQueue, or waiting for the notifications to be delivered.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message