hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Júlio Pires <juliocspi...@gmail.com>
Subject Re: Question About Distributed Mode
Date Thu, 05 Sep 2013 17:48:56 GMT
In this scenario was not using an external Zookeeper (Hama starts an
embedded, correct?).

I redid my environment. However, I have found the problem, but not the
solution.

On physical machines, the example works correctly (localhost/pseudo
distributed mode).
In tests on virtual machines via qemu, also works.

But, when I do tests on virtual machines (via cloud) dont work.

Is there any specific configuration to run on virtual machines in Cloud?



2013/9/4 Edward J. Yoon <edwardyoon@apache.org>

> Please see the zookeeper logs and check whether zookeeper is running.
> Also, you need to check the "hama.zookeeper.quorum",
> "hama.zookeeper.property.clientPort" properties are correct.
>
>
>
> On Wed, Sep 4, 2013 at 10:17 AM, Júlio Pires <juliocspires@gmail.com>
> wrote:
> > Thanks Edward!
> >
> > I'm running with the following scenario:
> > JDK 7
> > Hadoop: 1.2.1 (is compatible, correct?)
> > Hama: 0.6.3
> >
> > grooservers e  hama.zookeeper.quorum com o endereço das três (master,
> > slave_a e slave_b).
> >
> > However, when trying to run the PI example, the following errors occur:
> > ------------------------------------------------
> > ERRO 1 - Arquivo (hama-bspmaster.log)
> > -------------------------------------------------
> > 2013-09-04 02:55:39,369 INFO
> > org.apache.hama.bsp.sync.ZKSyncBSPMasterClient: Initialized ZK false
> > 2013-09-04 02:55:39,369 INFO org.apache.hama.bsp.sync.ZKSyncClient:
> > Initializing ZK Sync Client
> > 2013-09-04 02:55:39,513 *ERROR
> > org.apache.hama.bsp.sync.ZKSyncBSPMasterClient:
> > org.apache.zookeeper.KeeperException$ConnectionLossException:
> > KeeperErrorCode = ConnectionLoss for /bsp*
> >         at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
> >         at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> >         at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
> >         at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1069)
> >         at
> >
> org.apache.hama.bsp.sync.ZKSyncBSPMasterClient.init(ZKSyncBSPMasterClient.java:62)
> >         at org.apache.hama.bsp.BSPMaster.initZK(BSPMaster.java:509)
> >         at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:492)
> >         at org.apache.hama.bsp.BSPMaster.startMaster(BSPMaster.java:475)
> >         at org.apache.hama.BSPMasterRunner.run(BSPMasterRunner.java:46)
> >
> > -----------------------------------------------
> > ERRO 2: Arquivo: tasklog/attempt_201309040255_0001_000003_0.log"
> > -----------------------------------------------
> >
> > 13/09/04 02:57:21 INFO sync.ZooKeeperSyncClientImpl: Start connecting to
> > Zookeeper! At /192.168.122.127:61001
> > 13/09/04 02:57:22 *ERROR sync.ZooKeeperSyncClientImpl:
> > org.apache.zookeeper.KeeperException$NodeExistsException:
> KeeperErrorCode =
> > NodeExists for /bsp/job_201309040255_0001/peers*
> > 13/09/04 02:57:22 INFO ipc.Server: Starting SocketReader
> > 13/09/04 02:57:22 INFO ipc.Server: IPC Server Responder: starting
> > 13/09/04 02:57:22 INFO ipc.Server: IPC Server listener on 61001: starting
> >
> > What can it be?
> >
> >
> >
> > 2013/9/3 Edward J. Yoon <edwardyoon@apache.org>
> >
> >> > Questions:
> >> > 1) In the files "groomservers" and hama-site.xml (property
> >> > hama.zookeeper.quorum ), should be included the three machines or just
> >> > slave_a and slave_b?
> >>
> >> There's no great difference either way. If the BSP application
> >> requires large amount of RAM and hdfs-namenode is also started on
> >> master server, the latter is best (large cluster case).
> >>
> >> > 2) With the running environment, how do I add a new slave machine
> >> > On-the-fly?
> >>
> >> Just start groom server to add new slave machine:
> >>
> >> user@new_slave_c $ bin/hama-daemons.sh --config $HAMA_CONF_DIR start
> groom
> >>
> >> Then, it will be recognized automatically.
> >>
> >> On Wed, Sep 4, 2013 at 3:58 AM, Júlio Pires <juliocspires@gmail.com>
> >> wrote:
> >> > Hello,
> >> >
> >> > I have three machines, named as follows: master, slave_a, slave_b
> >> >
> >> > Questions:
> >> > 1) In the files "groomservers" and hama-site.xml (property
> >> > hama.zookeeper.quorum ), should be included the three machines or just
> >> > slave_a and slave_b?
> >> >
> >> > 2) With the running environment, how do I add a new slave machine
> >> > On-the-fly?
> >> >
> >> > Thanks!
> >>
> >>
> >>
> >> --
> >> Best Regards, Edward J. Yoon
> >> @eddieyoon
> >>
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message