hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-95) dfs validation
Date Fri, 24 Mar 2006 10:42:28 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-95?page=all ]

Konstantin Shvachko updated HADOOP-95:
--------------------------------------

    Attachment: TestReadFS.java
                IOMapperAdapter.java
                AccumulatingReducer.java

This map-reduce test reads all blocks of all files, and detects which of them are missing
or corrupted.
See HADOOP-101 discussion.


> dfs validation
> --------------
>
>          Key: HADOOP-95
>          URL: http://issues.apache.org/jira/browse/HADOOP-95
>      Project: Hadoop
>         Type: Improvement
>   Components: dfs
>     Versions: 0.1
>     Reporter: Hairong Kuang
>  Attachments: AccumulatingReducer.java, IOMapperAdapter.java, TestReadFS.java
>
> Dfs needs a validation operation similiar to fsck, so that we get to know the files that
are corrupted and which data blocks are missing.
> Dfs namenode also needs to log more specific information such as which block is replication
or is deleted. So when something goes wrong, we have a clue what has happened.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


Mime
View raw message