hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4895) Add a function of "-fixmisplaced" to fsck for fixing blocks in mistaken placed
Date Sat, 08 Jun 2013 00:46:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678627#comment-13678627
] 

Junping Du commented on HDFS-4895:
----------------------------------

Hi Colin, this is also a option. However, IMO, balancer is more to address the balanced distribution
of data, and its algorithm now is to match aboveAvg node with underAvg node and then scan
blocks on specific nodes rather than scan all blocks in HDFS or under specific directory.
fsck may more suitable as its responsibility is to scan all blocks under specific directory,
check block replica robust status, and report corrupt ones. Thoughts?
                
> Add a function of "-fixmisplaced" to fsck for fixing blocks in mistaken placed
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-4895
>                 URL: https://issues.apache.org/jira/browse/HDFS-4895
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Junping Du
>            Assignee: Junping Du
>              Labels: BlockPlacementPolicy
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message