hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660
Date Wed, 24 Aug 2016 22:07:21 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yongjun Zhang updated HDFS-10652:
---------------------------------
    Attachment: HDFS-10652.006.patch

Hi [~vinayrpet],

Sorry for the delay. I finally got to look at this case again. 

I found that it's not that we are shutting down wrong DNs. It's because the block report of
the new DN did not make to NN when we do the read, from time to time.  So I introduced some
new code to trigger block report instead of
{code}
DFSTestUtil.waitForReplication(fs, fileName, (short)3, 2000);
{code}
which doesn't seem to guarantee block report is received by NN.

With this change, the test appears to fail stably with checksum error when without the fix
of HDFS-4660/HDFS-9220, and succeed stably with the fixes.

Would you please take a look?

Thanks.


> Add a unit test for HDFS-4660
> -----------------------------
>
>                 Key: HDFS-10652
>                 URL: https://issues.apache.org/jira/browse/HDFS-10652
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode, hdfs
>            Reporter: Yongjun Zhang
>            Assignee: Vinayakumar B
>         Attachments: HDFS-10652-002.patch, HDFS-10652.001.patch, HDFS-10652.003.patch,
HDFS-10652.004.patch, HDFS-10652.005.patch, HDFS-10652.006.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message