hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-95) dfs validation
Date Fri, 24 Mar 2006 10:42:28 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-95?page=all ]

Konstantin Shvachko updated HADOOP-95:

    Attachment: TestReadFS.java

This map-reduce test reads all blocks of all files, and detects which of them are missing
or corrupted.
See HADOOP-101 discussion.

> dfs validation
> --------------
>          Key: HADOOP-95
>          URL: http://issues.apache.org/jira/browse/HADOOP-95
>      Project: Hadoop
>         Type: Improvement
>   Components: dfs
>     Versions: 0.1
>     Reporter: Hairong Kuang
>  Attachments: AccumulatingReducer.java, IOMapperAdapter.java, TestReadFS.java
> Dfs needs a validation operation similiar to fsck, so that we get to know the files that
are corrupted and which data blocks are missing.
> Dfs namenode also needs to log more specific information such as which block is replication
or is deleted. So when something goes wrong, we have a clue what has happened.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message