incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: Multiple tasks.
Date Wed, 05 Oct 2011 06:45:20 GMT
11/10/05 15:22:45 ERROR bsp.BSPPeer: java.io.IOException: Call to
cnode03/10.7.1.3:61016 failed on local exception: java.io.IOException:
Connection reset by peer
11/10/05 15:22:45 WARN bsp.GroomServer: Error running child
java.lang.NullPointerException
        at org.apache.hama.bsp.BSPPeer.sync(BSPPeer.java:339)


# vi core/logs/tasklogs/1/attempt_201110051521_0001_000163_0.log

11/10/05 15:22:36 DEBUG bsp.GroomServer: BSPPeerChild starting
11/10/05 15:22:37 DEBUG bsp.BSPPeer: Quorum  hnode1:21810
11/10/05 15:22:37 DEBUG bsp.BSPPeer: reinitialize(): cnode03:61016
11/10/05 15:22:37 INFO metrics.RpcMetrics: Initializing RPC Metrics
with hostName=BSPPeer, port=61016
11/10/05 15:22:37 INFO ipc.Server: IPC Server Responder: starting
11/10/05 15:22:37 INFO ipc.Server: IPC Server listener on 61016: starting
11/10/05 15:22:37 INFO bsp.BSPPeer:  BSPPeer address:cnode03 port:61016
11/10/05 15:22:37 INFO ipc.Server: IPC Server handler 0 on 61016: starting
11/10/05 15:22:37 INFO bsp.BSPPeer: >>>> cnode03:61016
....
11/10/05 15:22:37 INFO bsp.BSPPeer: xxxx 1. At superstep: 0 which task
is waiting? attempt_201110051521_0001_000163_0 stat is null? null
11/10/05 15:22:41 INFO bsp.BSPPeer: >>>>>>>>>>>>>>>
at superstep 0
taskid:attempt_201110051521_0001_000163_0 is notified.
11/10/05 15:22:41 DEBUG bsp.BSPPeer: xxxx 2. at superstep: 0 after
waiting ...attempt_201110051521_0001_000163_0
11/10/05 15:22:45 WARN bsp.GroomServer: Error running child
java.lang.NullPointerException
        at org.apache.hadoop.ipc.Client$Connection.handleConnectionFailure(Client.java:351)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:313)
        at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:176)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:860)
        at org.apache.hadoop.ipc.Client.call(Client.java:720)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
        at $Proxy2.put(Unknown Source)
        at org.apache.hama.bsp.BSPPeer.sync(BSPPeer.java:339)
        at org.apache.hama.examples.RandBench$RandBSP.bsp(RandBench.java:67)
        at org.apache.hama.bsp.BSPTask.run(BSPTask.java:60)
        at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:962)
11/10/05 15:22:45 INFO zookeeper.ZooKeeper: Session: 0x132d2be692e0112 closed
11/10/05 15:22:45 INFO ipc.Server: Stopping server on 61016
11/10/05 15:22:45 INFO ipc.Server: Stopping IPC Server listener on 61016
11/10/05 15:22:45 INFO ipc.Server: IPC Server handler 0 on 61016: exiting
11/10/05 15:22:45 INFO ipc.Server: Stopping IPC Server Responder


On Wed, Oct 5, 2011 at 3:15 PM, Thomas Jungblut
<thomas.jungblut@googlemail.com> wrote:
> Is there no tasklog directory in your log directory?
>
> 2011/10/5 Edward J. Yoon <edwardyoon@apache.org>
>
>> Currently, I can't run Hama on large cluster using 20+ more tasks per
>> node and can't see any logs.
>>
>> Tasks are finishes as soon as started.
>>
>> root@cnode01:/usr/local/src/hama-trunk# core/bin/hama jar
>> examples/target/hama-e
>>        xamples-0.4.0-incubating-SNAPSHOT.jar bench 16 1000 30
>> 11/10/05 11:10:35 DEBUG bsp.BSPJobClient: BSPJobClient.submitJobDir:
>> hdfs://hnode15:9000/tmp/hadoop-root/bsp/system/submit_d3wx1z
>> 11/10/05 11:10:35 INFO bsp.BSPJobClient: Running job: job_201110051110_0001
>> 11/10/05 11:10:38 INFO bsp.BSPJobClient: Current supersteps number: 0
>>
>> master log:
>>
>> 2011-10-05 11:10:34,860 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 0 on 40000: starting
>> 2011-10-05 11:10:34,863 INFO org.apache.hama.bsp.BSPMaster: Starting
>> RUNNING
>> 2011-10-05 11:10:34,892 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode10_50000 is added.
>> 2011-10-05 11:10:34,908 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode07_50000 is added.
>> 2011-10-05 11:10:34,919 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode05_50000 is added.
>> 2011-10-05 11:10:34,934 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode01_50000 is added.
>> 2011-10-05 11:10:34,945 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode06_50000 is added.
>> 2011-10-05 11:10:34,961 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode04_50000 is added.
>> 2011-10-05 11:10:34,973 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode08_50000 is added.
>> 2011-10-05 11:10:34,984 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode02_50000 is added.
>> 2011-10-05 11:10:34,997 INFO org.apache.hama.bsp.BSPMaster:
>> groomd_cnode03_50000 is added.
>> 2011-10-05 11:10:35,920 DEBUG org.apache.hama.bsp.JobInProgress:
>> numBSPTasks: 162
>> 2011-10-05 11:10:35,949 DEBUG org.apache.hama.bsp.JobInProgress: Job
>> is initialized.
>> 2011-10-05 11:10:50,087 INFO org.apache.hama.bsp.JobInProgress: Taskid
>> 'attempt_201110051110_0001_000034_0' has finished successfully: 0
>> 2011-10-05 11:10:50,087 INFO org.apache.hama.bsp.TaskInProgress: Task
>> 'task_201110051110_0001_000034' has completed.
>> 2011-10-05 11:10:50,267 INFO org.apache.hama.bsp.JobInProgress: Taskid
>> 'attempt_201110051110_0001_000158_0' has finished successfully: 0
>> 2011-10-05 11:10:50,267 INFO org.apache.hama.bsp.TaskInProgress: Task
>> 'task_201110051110_0001_000158' has completed.
>> 2011-10-05 11:10:51,122 INFO org.apache.hama.bsp.JobInProgress: Taskid
>> 'attempt_201110051110_0001_000074_0' has finished successfully: 0
>> 2011-10-05 11:10:51,122 INFO org.apache.hama.bsp.TaskInProgress: Task
>> 'task_201110051110_0001_000074' has completed.
>> 2011-10-05 11:10:51,178 INFO org.apache.hama.bsp.JobInProgress: Taskid
>> 'attempt_201110051110_0001_000112_0' has finished successfully: 0
>> 2011-10-05 11:10:51,178 INFO org.apache.hama.bsp.TaskInProgress: Task
>> 'task_201110051110_0001_000112' has completed.
>> 2011-10-05 11:10:51,268 INFO org.apache.hama.bsp.JobInProgress: Taskid
>> 'attempt_201110051110_0001_000159_0' has finished successfully: 0
>> 2011-10-05 11:10:51,268 INFO org.apache.hama.bsp.TaskInProgress: Task
>> 'task_201110051110_0001_000159' has completed.
>> 2011-10-05 11:10:51,385 INFO org.apache.hama.bsp.JobInProgress: Taskid
>> 'attempt_201110051110_0001_000075_0' has finished successfully: 0
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
>
>
>
> --
> Thomas Jungblut
> Berlin <thomas.jungblut@gmail.com>
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Mime
View raw message