Return-Path: X-Original-To: apmail-giraph-dev-archive@www.apache.org Delivered-To: apmail-giraph-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 16D02948C for ; Tue, 2 Oct 2012 02:55:08 +0000 (UTC) Received: (qmail 97509 invoked by uid 500); 2 Oct 2012 02:55:07 -0000 Delivered-To: apmail-giraph-dev-archive@giraph.apache.org Received: (qmail 97475 invoked by uid 500); 2 Oct 2012 02:55:07 -0000 Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@giraph.apache.org Delivered-To: mailing list dev@giraph.apache.org Received: (qmail 97466 invoked by uid 500); 2 Oct 2012 02:55:07 -0000 Delivered-To: apmail-incubator-giraph-dev@incubator.apache.org Received: (qmail 97463 invoked by uid 99); 2 Oct 2012 02:55:07 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Oct 2012 02:55:07 +0000 Date: Tue, 2 Oct 2012 13:55:07 +1100 (NCT) From: "Maja Kabiljo (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: <1635147299.152782.1349146507753.JavaMail.jiratomcat@arcas> In-Reply-To: <2002219.153.1344433461103.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Updated] (GIRAPH-293) Should aggregators be checkpointed? MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GIRAPH-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maja Kabiljo updated GIRAPH-293: -------------------------------- Attachment: GIRAPH-293.patch Rebased, but a test for this fails now because of GIRAPH-355 (which was introduced recently with GIRAPH-274). > Should aggregators be checkpointed? > ----------------------------------- > > Key: GIRAPH-293 > URL: https://issues.apache.org/jira/browse/GIRAPH-293 > Project: Giraph > Issue Type: Bug > Reporter: Alessandro Presta > Assignee: Maja Kabiljo > Attachments: GIRAPH-293.patch, GIRAPH-293.patch, GIRAPH-293.patch, GIRAPH-293.patch, GIRAPH-293.patch > > > As I understand, we don't include aggregators in checkpoints because they are kept in the Zookeeper. > One of our bootcampers is working on fixing TestManualCheckpoint, which currently involves starting a new job from a checkpoint from a previous job*. > If this is a functionality we want going forward, then persistent aggregators should be checkpointed. > [*] That test relies on the fact that either aggregators are checkpointed or they are always reset at each superstep. None of these is happening, but the error cancels out with the fact that we are not actually resuming from a checkpoint, but re-running the job from scratch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira