hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bryan Pendleton (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-95) dfs validation
Date Thu, 31 Aug 2006 19:09:23 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-95?page=comments#action_12431947 ] 
            
Bryan Pendleton commented on HADOOP-95:
---------------------------------------

I think Eric's comment (http://issues.apache.org/jira/browse/HADOOP-95#action_12371188) is
still important. But, probably a new issue to bring up. Ongoing validation/balancing/etc.
are still problems - the "fsck" utility just covers the top-level problem.

> dfs validation
> --------------
>
>                 Key: HADOOP-95
>                 URL: http://issues.apache.org/jira/browse/HADOOP-95
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: dfs
>    Affects Versions: 0.1.0
>            Reporter: Hairong Kuang
>         Attachments: AccumulatingReducer.java, IOMapperAdapter.java, TestDFSIO.java,
TestReadFS.java
>
>
> Dfs needs a validation operation similiar to fsck, so that we get to know the files that
are corrupted and which data blocks are missing.
> Dfs namenode also needs to log more specific information such as which block is replication
or is deleted. So when something goes wrong, we have a clue what has happened.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message