hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660
Date Wed, 24 Aug 2016 22:07:21 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Yongjun Zhang updated HDFS-10652:
    Attachment: HDFS-10652.006.patch

Hi [~vinayrpet],

Sorry for the delay. I finally got to look at this case again. 

I found that it's not that we are shutting down wrong DNs. It's because the block report of
the new DN did not make to NN when we do the read, from time to time.  So I introduced some
new code to trigger block report instead of
DFSTestUtil.waitForReplication(fs, fileName, (short)3, 2000);
which doesn't seem to guarantee block report is received by NN.

With this change, the test appears to fail stably with checksum error when without the fix
of HDFS-4660/HDFS-9220, and succeed stably with the fixes.

Would you please take a look?


> Add a unit test for HDFS-4660
> -----------------------------
>                 Key: HDFS-10652
>                 URL: https://issues.apache.org/jira/browse/HDFS-10652
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode, hdfs
>            Reporter: Yongjun Zhang
>            Assignee: Vinayakumar B
>         Attachments: HDFS-10652-002.patch, HDFS-10652.001.patch, HDFS-10652.003.patch,
HDFS-10652.004.patch, HDFS-10652.005.patch, HDFS-10652.006.patch

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message