hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuesheng Hu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-635) numberVertices value is inconsistent among tasks
Date Wed, 05 Sep 2012 13:05:07 GMT

    [ https://issues.apache.org/jira/browse/HAMA-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13448694#comment-13448694
] 

Yuesheng Hu commented on HAMA-635:
----------------------------------

*I add a println in GraphJobRunner to print the numberVertices, run PageRankTest in local
mode:*

12/09/05 20:24:48 INFO bsp.BSPJobClient: Running job: job_localrunner_0001
12/09/05 20:24:48 INFO bsp.LocalBSPRunner: Setting up a new barrier for 2 tasks!
12/09/05 20:24:48 INFO graph.GraphJobRunner: local:1: 1
12/09/05 20:24:48 INFO graph.GraphJobRunner: local:0: 1
*local:0 size is 8*
*local:1 size is 6*
12/09/05 20:24:51 INFO bsp.BSPJobClient: Current supersteps number: 66
12/09/05 20:24:51 INFO bsp.BSPJobClient: The total number of supersteps: 66
12/09/05 20:24:51 INFO bsp.BSPJobClient: Counters: 9
12/09/05 20:24:51 INFO bsp.BSPJobClient:   org.apache.hama.bsp.JobInProgress$JobCounter
12/09/05 20:24:51 INFO bsp.BSPJobClient:     LAUNCHED_TASKS=2
12/09/05 20:24:51 INFO bsp.BSPJobClient:   org.apache.hama.bsp.BSPPeerImpl$PeerCounter
12/09/05 20:24:51 INFO bsp.BSPJobClient:     SUPERSTEPS=66
12/09/05 20:24:51 INFO bsp.BSPJobClient:     SUPERSTEP_SUM=134
12/09/05 20:24:51 INFO bsp.BSPJobClient:     IO_BYTES_READ=216
12/09/05 20:24:51 INFO bsp.BSPJobClient:     TIME_IN_SYNC_MS=107
12/09/05 20:24:51 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_SENT=1036
12/09/05 20:24:51 INFO bsp.BSPJobClient:     TASK_INPUT_RECORDS=6
12/09/05 20:24:51 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_RECEIVED=504
12/09/05 20:24:51 INFO bsp.BSPJobClient:     TASK_OUTPUT_RECORDS=7
stackoverflow.com / 0.24891494617823817
facebook.com / 0.05048538790450821
yahoo.com / 0.33440928661451097
nasa.gov / 0.18473006317447804
twitter.com / 0.05209662257385163
youtube.com / 0.03779242729188219
google.com / 0.09029947299673252
Sum is: 0.9987282067342016

The vertices size is different between task 0 and task 1.

*After patch, the number becomes to same:*


12/09/05 20:30:12 INFO bsp.BSPJobClient: Running job: job_localrunner_0001
12/09/05 20:30:12 INFO bsp.LocalBSPRunner: Setting up a new barrier for 2 tasks!
12/09/05 20:30:12 INFO graph.GraphJobRunner: local:1: 1
12/09/05 20:30:12 INFO graph.GraphJobRunner: local:0: 1
*local:0 size is 7*
*local:1 size is 7*
12/09/05 20:30:15 INFO bsp.BSPJobClient: Current supersteps number: 67
12/09/05 20:30:15 INFO bsp.BSPJobClient: The total number of supersteps: 67
12/09/05 20:30:15 INFO bsp.BSPJobClient: Counters: 9
12/09/05 20:30:15 INFO bsp.BSPJobClient:   org.apache.hama.bsp.JobInProgress$JobCounter
12/09/05 20:30:15 INFO bsp.BSPJobClient:     LAUNCHED_TASKS=2
12/09/05 20:30:15 INFO bsp.BSPJobClient:   org.apache.hama.bsp.BSPPeerImpl$PeerCounter
12/09/05 20:30:15 INFO bsp.BSPJobClient:     SUPERSTEPS=67
12/09/05 20:30:15 INFO bsp.BSPJobClient:     SUPERSTEP_SUM=136
12/09/05 20:30:15 INFO bsp.BSPJobClient:     IO_BYTES_READ=216
12/09/05 20:30:15 INFO bsp.BSPJobClient:     TIME_IN_SYNC_MS=90
12/09/05 20:30:15 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_SENT=1044
12/09/05 20:30:15 INFO bsp.BSPJobClient:     TASK_INPUT_RECORDS=6
12/09/05 20:30:15 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_RECEIVED=508
12/09/05 20:30:15 INFO bsp.BSPJobClient:     TASK_OUTPUT_RECORDS=7
stackoverflow.com / 0.2590340404450072
facebook.com / 0.049884525105019104
yahoo.com / 0.34546042508640107
nasa.gov / 0.1917095856038324
twitter.com / 0.0449252446391441
youtube.com / 0.030791294909032405
google.com / 0.07710477569802211
Sum is: 0.9989098914864586

                
> numberVertices value is inconsistent  among tasks
> -------------------------------------------------
>
>                 Key: HAMA-635
>                 URL: https://issues.apache.org/jira/browse/HAMA-635
>             Project: Hama
>          Issue Type: Bug
>          Components: graph
>    Affects Versions: 0.5.0
>            Reporter: Yuesheng Hu
>            Assignee: Yuesheng Hu
>              Labels: None
>             Fix For: 0.6.0
>
>
> numberVertices = vertices.size() * peer.getNumPeers()
> numberVertices is not consistent among tasks because not all task been assigned the same
number of vertices.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message