hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Skater Xu (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HAMA-673) Integrate new service layers
Date Tue, 04 Feb 2014 12:32:10 GMT

    [ https://issues.apache.org/jira/browse/HAMA-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890609#comment-13890609
] 

Skater Xu edited comment on HAMA-673 at 2/4/14 12:31 PM:
---------------------------------------------------------

Hello Edward:
The HDFS2.x problem is caused by the protobuffer version.
After I upgrade protobufer2.4a.jar to protobuf-java-2.5.0.jar in $hamahome/lib, that problem
is gone(So it should relate to mavn build issue, do I need to log an issue and fix it there?)

Also I have tested with hadoop 2.0.3 alpha, itself has blocking issue, even cannot run the
mapreduce job. So currently I do not have a hadoop 2.x version which can run with hama.
May be we just use yarn 2.2.0 as code base.
For hoya, it is still under developing, which version do they want to support hama?

And after fix hdfs, zookeeper has error now

org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
for /bsp
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1069)
        at org.apache.hama.bsp.sync.ZKSyncBSPMasterClient.init(ZKSyncBSPMasterClient.java:62)
        at org.apache.hama.bsp.BSPMaster.initZK(BSPMaster.java:509)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:492)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:475)
        at org.apache.hama.BSPMasterRunner.run(BSPMasterRunner.java:46)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
        at org.apache.hama.BSPMasterRunner.main(BSPMasterRunner.java:56)


was (Author: skater):
The HDFS2.x problem is caused by the protobuffer version.
After I upgrade protobufer2.4a.jar to protobuf-java-2.5.0.jar in $hamahome/lib, that problem
is gone(So it should relate to mavn build issue, do I need to log an issue and fix it there?)
And after fix hdfs, zookeeper has error now

org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
for /bsp
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1069)
        at org.apache.hama.bsp.sync.ZKSyncBSPMasterClient.init(ZKSyncBSPMasterClient.java:62)
        at org.apache.hama.bsp.BSPMaster.initZK(BSPMaster.java:509)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:492)
        at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:475)
        at org.apache.hama.BSPMasterRunner.run(BSPMasterRunner.java:46)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
        at org.apache.hama.BSPMasterRunner.main(BSPMasterRunner.java:56)

> Integrate new service layers
> ----------------------------
>
>                 Key: HAMA-673
>                 URL: https://issues.apache.org/jira/browse/HAMA-673
>             Project: Hama
>          Issue Type: Sub-task
>          Components: bsp core, build , yarn
>            Reporter: Thomas Jungblut
>         Attachments: yarn-hama-diagram.pptx
>
>
> Integrate the services, messaging/synchronization/scheduler into YARN.
> The master must startup all the master services.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message