Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-issues@hadoop.apache.org
Date: Thu, 7 Mar 2013 06:42:12 +0000 (UTC)
From: "Suresh Srinivas (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.12635734.1362635768942.397815.1362638532454@arcas>
In-Reply-To: <JIRA.12635734.1362635768942@arcas>
References: <JIRA.12635734.1362635768942@arcas>
Subject: [jira] [Commented] (HDFS-4562) Many excess replicas getting created
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HDFS-4562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595604#comment-13595604 ] 

Suresh Srinivas commented on HDFS-4562:
---------------------------------------

Can you also include in the log snippet, lines printed for the file /user/mapred/system/job_201303040902_85451/jobToken?

If I were to guess, one of the datanode in the pipeline reports a replica for a block late. The replication monitor is too aggressive and creates an additional replica meanwhile. However this should not happen for every block that is created. Can you please give the replication related configurations from hdfs-site.xml?
                
> Many excess replicas getting created
> ------------------------------------
>
>                 Key: HDFS-4562
>                 URL: https://issues.apache.org/jira/browse/HDFS-4562
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 1.1.1
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 1.2.0
>
>
> We are seeing too many excess replicas getting created in our cluster. The number excess replicas in day coming out to be more than 1 lakh.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira