From hdfs-issues-return-12720-apmail-hadoop-hdfs-issues-archive=hadoop.apache.org@hadoop.apache.org Tue Nov 02 21:08:58 2010 Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 79532 invoked from network); 2 Nov 2010 21:08:57 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 2 Nov 2010 21:08:57 -0000 Received: (qmail 46919 invoked by uid 500); 2 Nov 2010 21:09:29 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 46840 invoked by uid 500); 2 Nov 2010 21:09:28 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 46832 invoked by uid 99); 2 Nov 2010 21:09:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Nov 2010 21:09:28 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Nov 2010 21:09:28 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id oA2L97w7004181 for ; Tue, 2 Nov 2010 21:09:08 GMT Message-ID: <23532312.205351288732147960.JavaMail.jira@thor> Date: Tue, 2 Nov 2010 17:09:07 -0400 (EDT) From: "Hairong Kuang (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Commented: (HDFS-1457) Limit transmission rate when transfering image between primary and secondary NNs In-Reply-To: <20990968.146771287081033153.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927596#action_12927596 ] Hairong Kuang commented on HDFS-1457: ------------------------------------- How about I use a default value of 0 to indicate that no need to throttle? > Limit transmission rate when transfering image between primary and secondary NNs > -------------------------------------------------------------------------------- > > Key: HDFS-1457 > URL: https://issues.apache.org/jira/browse/HDFS-1457 > Project: Hadoop HDFS > Issue Type: Improvement > Components: name-node > Affects Versions: 0.22.0 > Reporter: Hairong Kuang > Assignee: Hairong Kuang > Fix For: 0.22.0 > > Attachments: checkpoint-limitandcompress.patch, trunkThrottleImage.patch > > > If the fsimage is very big. The network is full in a short time when SeconaryNamenode do checkpoint, leading to Jobtracker access Namenode to get relevant file data to fail in job initialization phase. So we limit transmission speed and compress transmission to resolve the problem. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.