hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4562) Many excess replicas getting created
Date Thu, 07 Mar 2013 06:42:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595604#comment-13595604

Suresh Srinivas commented on HDFS-4562:

Can you also include in the log snippet, lines printed for the file /user/mapred/system/job_201303040902_85451/jobToken?

If I were to guess, one of the datanode in the pipeline reports a replica for a block late.
The replication monitor is too aggressive and creates an additional replica meanwhile. However
this should not happen for every block that is created. Can you please give the replication
related configurations from hdfs-site.xml?
> Many excess replicas getting created
> ------------------------------------
>                 Key: HDFS-4562
>                 URL: https://issues.apache.org/jira/browse/HDFS-4562
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 1.1.1
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 1.2.0
> We are seeing too many excess replicas getting created in our cluster. The number excess
replicas in day coming out to be more than 1 lakh.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message