hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: hbase.cluster.distributed property in hbase-site.xml
Date Thu, 15 Aug 2013 13:32:04 GMT
Hi Vinay,

I'm not 100% sure but I think the key is ZooKeeper...

    <description>The mode the cluster will be in. Possible values are
      false: standalone and pseudo-distributed setups with managed Zookeeper
      true: fully-distributed with unmanaged Zookeeper Quorum (see
hbase-env.sh)
    </description>

On my side, I have an external ZK, so I have put this as true even if I'm
pseudo-distributed since I want to handle ZK myself. But if you want a
Pseudo-Distributed mode and you want to let HBase manage ZK, then you need
to put it at false.

If you put it at true, then you have to specify the qorum property too.

My understanding.

JM

2013/8/15 Vinay Mehta <vinay.p.mehta@gmail.com>

> Hi Ted/Jean
> Can you help in understanding conflicting statements in official reference
> guide as i mentioned above ?
>
>
> On Thu, Aug 15, 2013 at 6:51 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > Vinay:
> > In http://hbase.apache.org/book.html , take a look at  14.3.1.2.
> Hardware
> >
> >
> > On Thu, Aug 15, 2013 at 4:47 AM, Jean-Marc Spaggiari <
> > jean-marc@spaggiari.org> wrote:
> >
> > > If you want want to run the application but no MR jobs, small CPU is
> > > enought. If you want to inject big load and run big jobs, will require
> > big
> > > CPU...
> > >
> > > JM
> > >
> > > 2013/8/15 Vinay Mehta <vinay.p.mehta@gmail.com>
> > >
> > > > Hi,
> > > > Thanks Jean.
> > > > I will take care of your advice in future.
> > > > What about CPU configuration ?
> > > >
> > > >
> > > > On Thu, Aug 15, 2013 at 4:51 PM, Jean-Marc Spaggiari <
> > > > jean-marc@spaggiari.org> wrote:
> > > >
> > > > > Hi Vinay,
> > > > >
> > > > > 2 things.
> > > > >
> > > > > First, you should not expect the list to be available 24/7 to reply
> > to
> > > > your
> > > > > questions in less that 2 hours. People here are all voloneers from
> > the
> > > > > community, and something, they mightnot have the time, or might be
> > > > > sleeping, or might not know, or anything else.
> > > > >
> > > > > Second, here is what you need to setup for a pseudo-distributed
> node.
> > > > don't
> > > > > forget that you need at least 16GB on this node if you want it to
> > work
> > > > > correctly.
> > > > >
> > > > > <configuration>
> > > > >   <property>
> > > > >     <name>hbase.rootdir</name>
> > > > >     <value>hdfs://hbasetest:9000/hbase</value>
> > > > >   </property>
> > > > >   <property>
> > > > >     <name>hbase.cluster.distributed</name>
> > > > >     <value>true</value>
> > > > >   </property>
> > > > >   <property>
> > > > >     <name>hbase.zookeeper.quorum</name>
> > > > >     <value>hbasetest</value>
> > > > >   </property>
> > > > > </configuration>
> > > > >
> > > > > In this mode, I start Hadoop and ZooKeeper manually.
> > > > >
> > > > > JM
> > > > >
> > > > > 2013/8/15 Vinay Mehta <vinay.p.mehta@gmail.com>
> > > > >
> > > > > > Some one please reply.
> > > > > > I am asking this as at one place in official reference guide
its
> > > > > mentioned
> > > > > > as true as show below :-
> > > > > >
> > > > > > 2.2.2.1.1. Pseudo-distributed Configuration File
> > > > > >
> > > > > > Below is a sample pseudo-distributed file for the node
> > > > > h-24-30.example.com
> > > > > > .
> > > > > > hbase-site.xml
> > > > > >
> > > > > > <configuration>
> > > > > >   ...*  <property>
> > > > > >     <name>hbase.rootdir</name>
> > > > > >     <value>hdfs://h-24-30.sfo.stumble.net:8020/hbase</value>
> > > > > >   </property>
> > > > > >   <property>
> > > > > >     <name>hbase.cluster.distributed</name>
> > > > > >     <value>true</value>  </property>*
> > > > > >
> > > > > >
> > > > > > Where as at another place in same file its mentioned as
> > > > > >
> > > > > > 2.4.1.1. hbase-site.xml
> > > > > >
> > > > > > <?xml version="1.0"?>
> > > > > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > > > > > <configuration>
> > > > > > .....
> > > > > >  * <property>
> > > > > >     <name>hbase.cluster.distributed</name>
> > > > > >     <value>true</value>
> > > > > >     <description>The mode the cluster will be in. Possible
values
> > are
> > > > > >       false: standalone and pseudo-distributed setups with
> managed
> > > > > > Zookeeper
> > > > > >       true: fully-distributed with unmanaged Zookeeper Quorum
> (see
> > > > > > hbase-env.sh)
> > > > > >     </description>
> > > > > >   </property>*
> > > > > > </configuration>
> > > > > >
> > > > > >
> > > > > >
> > > > > > So its contradictory and hence i am confused. :(
> > > > > > Also  As i have single machine which will hosts all daemons
of
> > hadoop
> > > > and
> > > > > > hbase what should be the ideal cpu and memory configuration
?
> > > > > >
> > > > > > Regards,
> > > > > > Vinay
> > > > > >
> > > > > > On Thu, Aug 15, 2013 at 12:45 PM, Vinay Mehta <
> > > vinay.p.mehta@gmail.com
> > > > > > >wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > > I am newbie to Hbase and Hadoop.
> > > > > > > I am trying to configure Hbase and Hadoop in pseudo distributed
> > > mode.
> > > > > > > I have few questions.
> > > > > > >
> > > > > > > 1) what should hbase.cluster.distributed be set to in
> > > hbase-site.xml
> > > > > for
> > > > > > > pseudo distributed mode.
> > > > > > > Is it false for stanalone mode and true for both pseudo
> > distributed
> > > > and
> > > > > > > fully distributed mode ?
> > > > > > >
> > > > > > > 2) As i have single machine which will hosts all daemons
of
> > hadoop
> > > > and
> > > > > > > hbase what should be the ideal cpu and memory configuration
?
> > > > > > >
> > > > > > > Thanks for your time.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Vinay
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message