hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition
Date Tue, 16 Oct 2012 22:33:02 GMT

     [ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Nauroth updated HDFS-4065:
--------------------------------

    Attachment: HDFS-4065-branch-1-win.patch

With this patch, the test fully shuts down the MiniDFSCluster before corrupting the block
files. Then, it restarts the MiniDFSCluster (without reformatting) and continues with the
assertions. Shutting down MiniDFSCluster synchronously waits for completion of all DataXceiver
threads, so there is no locking conflict.

With this version of the code, the test consistently passes for me on Mac and Windows Server
2008.
                
> TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race
condition
> -----------------------------------------------------------------------------------------------
>
>                 Key: HDFS-4065
>                 URL: https://issues.apache.org/jira/browse/HDFS-4065
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1-win
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: HDFS-4065-branch-1-win.patch
>
>
> TestDFSShell.testGet attempts to simulate corruption of block files in order to test
hadoop fs -get with the -ignoreCrc option.  It is possible that the data node's DataXceiver
thread has not yet closed the block file.  This causes a locking violation on Windows, so
the test fails.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message