Return-Path: X-Original-To: apmail-hama-dev-archive@www.apache.org Delivered-To: apmail-hama-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 67B1CD345 for ; Wed, 5 Sep 2012 13:05:09 +0000 (UTC) Received: (qmail 57367 invoked by uid 500); 5 Sep 2012 13:05:09 -0000 Delivered-To: apmail-hama-dev-archive@hama.apache.org Received: (qmail 57088 invoked by uid 500); 5 Sep 2012 13:05:08 -0000 Mailing-List: contact dev-help@hama.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hama.apache.org Delivered-To: mailing list dev@hama.apache.org Received: (qmail 56955 invoked by uid 500); 5 Sep 2012 13:05:08 -0000 Delivered-To: apmail-incubator-hama-dev@incubator.apache.org Received: (qmail 56948 invoked by uid 99); 5 Sep 2012 13:05:07 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Sep 2012 13:05:07 +0000 Date: Thu, 6 Sep 2012 00:05:07 +1100 (NCT) From: "Yuesheng Hu (JIRA)" To: hama-dev@incubator.apache.org Message-ID: <1930421210.38667.1346850307945.JavaMail.jiratomcat@arcas> In-Reply-To: <1505155393.37782.1346829427717.JavaMail.jiratomcat@arcas> Subject: [jira] [Commented] (HAMA-635) numberVertices value is inconsistent among tasks MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HAMA-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13448694#comment-13448694 ] Yuesheng Hu commented on HAMA-635: ---------------------------------- *I add a println in GraphJobRunner to print the numberVertices, run PageRankTest in local mode:* 12/09/05 20:24:48 INFO bsp.BSPJobClient: Running job: job_localrunner_0001 12/09/05 20:24:48 INFO bsp.LocalBSPRunner: Setting up a new barrier for 2 tasks! 12/09/05 20:24:48 INFO graph.GraphJobRunner: local:1: 1 12/09/05 20:24:48 INFO graph.GraphJobRunner: local:0: 1 *local:0 size is 8* *local:1 size is 6* 12/09/05 20:24:51 INFO bsp.BSPJobClient: Current supersteps number: 66 12/09/05 20:24:51 INFO bsp.BSPJobClient: The total number of supersteps: 66 12/09/05 20:24:51 INFO bsp.BSPJobClient: Counters: 9 12/09/05 20:24:51 INFO bsp.BSPJobClient: org.apache.hama.bsp.JobInProgress$JobCounter 12/09/05 20:24:51 INFO bsp.BSPJobClient: LAUNCHED_TASKS=2 12/09/05 20:24:51 INFO bsp.BSPJobClient: org.apache.hama.bsp.BSPPeerImpl$PeerCounter 12/09/05 20:24:51 INFO bsp.BSPJobClient: SUPERSTEPS=66 12/09/05 20:24:51 INFO bsp.BSPJobClient: SUPERSTEP_SUM=134 12/09/05 20:24:51 INFO bsp.BSPJobClient: IO_BYTES_READ=216 12/09/05 20:24:51 INFO bsp.BSPJobClient: TIME_IN_SYNC_MS=107 12/09/05 20:24:51 INFO bsp.BSPJobClient: TOTAL_MESSAGES_SENT=1036 12/09/05 20:24:51 INFO bsp.BSPJobClient: TASK_INPUT_RECORDS=6 12/09/05 20:24:51 INFO bsp.BSPJobClient: TOTAL_MESSAGES_RECEIVED=504 12/09/05 20:24:51 INFO bsp.BSPJobClient: TASK_OUTPUT_RECORDS=7 stackoverflow.com / 0.24891494617823817 facebook.com / 0.05048538790450821 yahoo.com / 0.33440928661451097 nasa.gov / 0.18473006317447804 twitter.com / 0.05209662257385163 youtube.com / 0.03779242729188219 google.com / 0.09029947299673252 Sum is: 0.9987282067342016 The vertices size is different between task 0 and task 1. *After patch, the number becomes to same:* 12/09/05 20:30:12 INFO bsp.BSPJobClient: Running job: job_localrunner_0001 12/09/05 20:30:12 INFO bsp.LocalBSPRunner: Setting up a new barrier for 2 tasks! 12/09/05 20:30:12 INFO graph.GraphJobRunner: local:1: 1 12/09/05 20:30:12 INFO graph.GraphJobRunner: local:0: 1 *local:0 size is 7* *local:1 size is 7* 12/09/05 20:30:15 INFO bsp.BSPJobClient: Current supersteps number: 67 12/09/05 20:30:15 INFO bsp.BSPJobClient: The total number of supersteps: 67 12/09/05 20:30:15 INFO bsp.BSPJobClient: Counters: 9 12/09/05 20:30:15 INFO bsp.BSPJobClient: org.apache.hama.bsp.JobInProgress$JobCounter 12/09/05 20:30:15 INFO bsp.BSPJobClient: LAUNCHED_TASKS=2 12/09/05 20:30:15 INFO bsp.BSPJobClient: org.apache.hama.bsp.BSPPeerImpl$PeerCounter 12/09/05 20:30:15 INFO bsp.BSPJobClient: SUPERSTEPS=67 12/09/05 20:30:15 INFO bsp.BSPJobClient: SUPERSTEP_SUM=136 12/09/05 20:30:15 INFO bsp.BSPJobClient: IO_BYTES_READ=216 12/09/05 20:30:15 INFO bsp.BSPJobClient: TIME_IN_SYNC_MS=90 12/09/05 20:30:15 INFO bsp.BSPJobClient: TOTAL_MESSAGES_SENT=1044 12/09/05 20:30:15 INFO bsp.BSPJobClient: TASK_INPUT_RECORDS=6 12/09/05 20:30:15 INFO bsp.BSPJobClient: TOTAL_MESSAGES_RECEIVED=508 12/09/05 20:30:15 INFO bsp.BSPJobClient: TASK_OUTPUT_RECORDS=7 stackoverflow.com / 0.2590340404450072 facebook.com / 0.049884525105019104 yahoo.com / 0.34546042508640107 nasa.gov / 0.1917095856038324 twitter.com / 0.0449252446391441 youtube.com / 0.030791294909032405 google.com / 0.07710477569802211 Sum is: 0.9989098914864586 > numberVertices value is inconsistent among tasks > ------------------------------------------------- > > Key: HAMA-635 > URL: https://issues.apache.org/jira/browse/HAMA-635 > Project: Hama > Issue Type: Bug > Components: graph > Affects Versions: 0.5.0 > Reporter: Yuesheng Hu > Assignee: Yuesheng Hu > Labels: None > Fix For: 0.6.0 > > > numberVertices = vertices.size() * peer.getNumPeers() > numberVertices is not consistent among tasks because not all task been assigned the same number of vertices. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira