Return-Path: X-Original-To: apmail-incubator-giraph-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-giraph-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 91F8B7944 for ; Fri, 14 Oct 2011 06:32:41 +0000 (UTC) Received: (qmail 23469 invoked by uid 500); 14 Oct 2011 06:32:38 -0000 Delivered-To: apmail-incubator-giraph-dev-archive@incubator.apache.org Received: (qmail 23404 invoked by uid 500); 14 Oct 2011 06:32:36 -0000 Mailing-List: contact giraph-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: giraph-dev@incubator.apache.org Delivered-To: mailing list giraph-dev@incubator.apache.org Received: (qmail 23320 invoked by uid 99); 14 Oct 2011 06:32:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Oct 2011 06:32:34 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Oct 2011 06:32:32 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 8268A307C21 for ; Fri, 14 Oct 2011 06:32:12 +0000 (UTC) Date: Fri, 14 Oct 2011 06:32:12 +0000 (UTC) From: "Jakob Homan (Commented) (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: <645583786.12870.1318573932535.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1578387723.12101.1318551372893.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (GIRAPH-52) There should be a scheme to limit the counter MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GIRAPH-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127299#comment-13127299 ] Jakob Homan commented on GIRAPH-52: ----------------------------------- That would be quite reasonable. It could implement either of the schemes above (or a different one), or for non-limited clusters just churn out the counters. > There should be a scheme to limit the counter > --------------------------------------------- > > Key: GIRAPH-52 > URL: https://issues.apache.org/jira/browse/GIRAPH-52 > Project: Giraph > Issue Type: Bug > Components: mapreduce > Affects Versions: 0.70.0 > Reporter: Zhiwei Gu > Fix For: 0.70.0 > > > For hadoop version above 0.20.203.0., the cluster-wise configuration mapreduce.job.counters.limit cannot be overrided, while the superstep iterations is not deterministic, the job might run several hundreds or even thousand of supersteps, it will always kill the job. This will limit the usage of Giraph and is tooooo bad. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira