hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1564) Write unit tests to detect CRC corruption
Date Wed, 04 Jul 2007 18:47:04 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

dhruba borthakur updated HADOOP-1564:

    Attachment: crctest.3

This test does the following creates a bunch of files/directories with replication factor
of 2. Then verifies that a client can automatically accesses the remining valid replica inspite
of the following tyoes of simulated errors:

1. Delete meta file on one replica
2. Truncates meta file on one replica
3. Corrupts the meta file header on one replica
4. Corrupts any random offset and portion of the meta file
5. Swaps two meta files, i.e the format of the meta files are valid but their CRCs do not
match with their corresponding data blocks

Another portion of the test is being commented out till HADOOP-1557 is addressed:
1. Create file with 2 replica, corrupt the meta file of replica, decrease replication factor
from 2 to 1. Validate that the remaining replica is the good one.
2. Create file with 2 replica, corrupt the meta file of one replica, increase replication
factor of file to 3. verify that the new replica was created from the non-corrupted replica.

> Write unit tests to detect CRC corruption
> -----------------------------------------
>                 Key: HADOOP-1564
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1564
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>         Attachments: crctest.3
> The unit tests should have some way to test the case when CRC files are corrupted.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message