hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yoram Arnon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-95) dfs validation
Date Tue, 21 Mar 2006 02:15:58 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-95?page=comments#action_12371179 ] 

Yoram Arnon commented on HADOOP-95:

we're thinking to have a name-server call that:
1. checks internal consistency
2. for each block, verifies that it actually exists on some data node
3. (optional, perhaps later) ask each data node to actually read its blocks and check their

> dfs validation
> --------------
>          Key: HADOOP-95
>          URL: http://issues.apache.org/jira/browse/HADOOP-95
>      Project: Hadoop
>         Type: Improvement
>   Components: dfs
>     Versions: 0.1
>     Reporter: Hairong Kuang

> Dfs needs a validation operation similiar to fsck, so that we get to know the files that
are corrupted and which data blocks are missing.
> Dfs namenode also needs to log more specific information such as which block is replication
or is deleted. So when something goes wrong, we have a clue what has happened.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message