Return-Path: X-Original-To: apmail-giraph-dev-archive@www.apache.org Delivered-To: apmail-giraph-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5193AD223 for ; Thu, 16 Aug 2012 22:23:32 +0000 (UTC) Received: (qmail 69657 invoked by uid 500); 16 Aug 2012 22:23:32 -0000 Delivered-To: apmail-giraph-dev-archive@giraph.apache.org Received: (qmail 69535 invoked by uid 500); 16 Aug 2012 22:23:32 -0000 Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@giraph.apache.org Delivered-To: mailing list dev@giraph.apache.org Received: (qmail 69527 invoked by uid 99); 16 Aug 2012 22:23:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Aug 2012 22:23:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of initialcontext@gmail.com designates 209.85.214.180 as permitted sender) Received: from [209.85.214.180] (HELO mail-ob0-f180.google.com) (209.85.214.180) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Aug 2012 22:23:25 +0000 Received: by obceq6 with SMTP id eq6so4265510obc.11 for ; Thu, 16 Aug 2012 15:23:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=xPsAOQCwQQVUPhwHLp1YXhAddnBAlDzX2jpnPNsMPdU=; b=Lg+o1a6Tb78i2JSSoKoNe8+R0tFDGEgPg393Pz9fdaUaF3YsAmJjH/pAz8mQqNbEpZ 0fxItJug9RWEoZJ1zE4RBRgvOCGkAHyJ6i5WgoB68z32Jij5cuhiSAJ5tQw5wH1eUBeH PjsRsb0flFb/zQ4ntewcZqbdjddNnKWPjoE1WNzz2HCuplkdX95Tk7aKOptH8obP4ZuE vr4yUBPh/wHClSGjtwaJpfPK+eNIQwpAZMBrJR2T2srvl4HB2D6gMfKDtApGltf+uNpm bj/jdIYJmT7laxNsfr8uWqpVxdVBsrvP7LEobDXGobc8/CME/ein+I3wVHUnxGQ+lKSw Zhww== MIME-Version: 1.0 Received: by 10.60.2.161 with SMTP id 1mr2260105oev.48.1345155784721; Thu, 16 Aug 2012 15:23:04 -0700 (PDT) Received: by 10.60.131.10 with HTTP; Thu, 16 Aug 2012 15:23:04 -0700 (PDT) In-Reply-To: <1492030190.21082.1345151738221.JavaMail.jiratomcat@arcas> References: <2034909505.1042.1344848258102.JavaMail.jiratomcat@arcas> <1492030190.21082.1345151738221.JavaMail.jiratomcat@arcas> Date: Thu, 16 Aug 2012 15:23:04 -0700 Message-ID: Subject: Re: [jira] [Reopened] (GIRAPH-297) Checkpointing on master is done one superstep later From: Eli Reisman To: dev@giraph.apache.org Content-Type: multipart/alternative; boundary=e89a8f923de4b745cc04c7697c27 --e89a8f923de4b745cc04c7697c27 Content-Type: text/plain; charset=ISO-8859-1 Sounds like this is a tough one. I think doing master compute after vertices is a little counter intuitive but if it fits the existing framework the best, then its the best option. I do think its a priority to make sure the super step numbers a user sees when working with a master compute or vertex in application code should like up perfectly so they see the sequencing as rational, and appearing to run master compute before the vertices even though it actually happens at the end of the previous superstep. If this means inserting a well-commented "X+1" in the plumbing code, it seems worth it to shield the user from having to work with master.compute 2 and vertex superstep 3 as if they were the same superstep. On Thu, Aug 16, 2012 at 2:15 PM, Maja Kabiljo (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/GIRAPH-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel] > > Maja Kabiljo reopened GIRAPH-297: > --------------------------------- > > > > Checkpointing on master is done one superstep later > > --------------------------------------------------- > > > > Key: GIRAPH-297 > > URL: https://issues.apache.org/jira/browse/GIRAPH-297 > > Project: Giraph > > Issue Type: Bug > > Reporter: Maja Kabiljo > > Assignee: Maja Kabiljo > > Attachments: GIRAPH-297-1.patch, GIRAPH-297-fix.patch, > GIRAPH-297.patch > > > > > > On workers we store checkpoint X before compute() for superstep X are > executed. On master we do it after those compute() are executed and after > master.compute() for superstep X+1. > > -- > This message is automatically generated by JIRA. > If you think it was sent incorrectly, please contact your JIRA > administrators: > https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa > For more information on JIRA, see: http://www.atlassian.com/software/jira > > > --e89a8f923de4b745cc04c7697c27--