Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of cstaszak@gmail.com designates
 209.85.222.198 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=Ok9WiSMGJKkf9uqdKlTPBtfqSH8G/zgqOpg9eraMLch2AArq8V9puEIV+hBJ0LzvdY
         /b+/YrPVndOxU8A0yZ6Op/2LezgjQZKe+c626KlileGwlZQN9ecdxo/WFCKtduyxw0j1
         Aet6vdVWwN4ibm6hAyy5uPwl4/FnmY2b/gI0E=
MIME-Version: 1.0
In-Reply-To: <7c962aed1001151442t59e5d855o1a2ea5ea805d00d2@mail.gmail.com>
References: <974463.4668.qm@web50307.mail.re2.yahoo.com>
	 <228772.82103.qm@web65514.mail.ac4.yahoo.com>
	 <64f07e2c1001151322h4e3a0f78t99766b9471e45486@mail.gmail.com>
	 <78568af11001151350p3ef01f8eq36434582154cc6a0@mail.gmail.com>
	 <94358.18837.qm@web65505.mail.ac4.yahoo.com>
	 <78568af11001151400u25a02797j6fed55833989fdf8@mail.gmail.com>
	 <910299.16144.qm@web50303.mail.re2.yahoo.com>
	 <78568af11001151427p75acf82ehba92a9df28d6321d@mail.gmail.com>
	 <7c962aed1001151442t59e5d855o1a2ea5ea805d00d2@mail.gmail.com>
Date: Fri, 15 Jan 2010 15:55:23 -0800
Message-ID: <8324b19f1001151555v7539e559q202eef3c4d62a6fa@mail.gmail.com>
Subject: Re: HBase on 1 box? how big?
From: Chris Staszak <cstaszak@gmail.com>
To: hbase-user <hbase-user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

+1 for this feature.

I understand some of the questioning along the lines of "why not use
PostgreSQL/MySQL" for a data store that just runs on one host.

However, the driver for me (and I suspect for a growing number of
people) is to write one piece of code that runs at any scale. For some
uses a single host/jvm makes perfect sense: development, demos or
limited production data size and transaction volume.

Furthermore, this could greatly simplify demos or small scale
deployments on Windows (removing the ssh requirement).

On Fri, Jan 15, 2010 at 2:42 PM, stack <stack@duboce.net> wrote:
> How about we add a 'standalone' argument to bin/hbase? =A0It'd check the
> hbase-site.xml to see it has right standalone basic config. and then it'd
> pass switches to start all up in the one JVM?
> St.Ack
>
> On Fri, Jan 15, 2010 at 2:27 PM, Ryan Rawson <ryanobjc@gmail.com> wrote:
>
>> i hadda resolve like 40 files of conflicts :-/
>>
>> what i really need though is a tool so that start-hbase.sh wont do the
>> 'normal' thing and just do hbase-daemon.sh start master when running
>> in standalone mode.
>>
>> -ryan
>>
>> On Fri, Jan 15, 2010 at 2:23 PM, Otis Gospodnetic
>> <otis_gospodnetic@yahoo.com> wrote:
>> > Sounds like a yummy patch, Ryan, if you need another nudge. :)
>> >
>> > Otis
>> >
>> >
>> >
>> > ----- Original Message ----
>> >> From: Ryan Rawson <ryanobjc@gmail.com>
>> >> To: hbase-user@hadoop.apache.org
>> >> Sent: Fri, January 15, 2010 5:00:42 PM
>> >> Subject: Re: HBase on 1 box? how big?
>> >>
>> >> Yes I do plan on releasing a patch, but i need to rebase it to trunk.
>> >> It moves a class from test -> java (ie; the ZK in JVM startup class).
>> >>
>> >> maybe soon?
>> >> -ryan
>> >>
>> >> On Fri, Jan 15, 2010 at 1:57 PM, Andrew Purtell wrote:
>> >> > That would be good for developing disconnected against the API. Any
>> >> > plan on releasing a patch Ryan?
>> >> >
>> >> > =A0 - Andy
>> >> >
>> >> >
>> >> >
>> >> > ----- Original Message ----
>> >> >> From: Ryan Rawson
>> >> >> To: hbase-user@hadoop.apache.org
>> >> >> Sent: Fri, January 15, 2010 1:50:32 PM
>> >> >> Subject: Re: HBase on 1 box? how big?
>> >> >>
>> >> >> You can run HBase on any size of machine all single node, by defau=
lt
>> >> >> when you start hbase it will store files in /tmp and everything is=
 in
>> >> >> 1 JVM. =A0How much data can you jam in there? =A0I'm not totally s=
ure,
>> >> >> probably a lot more than you might think, but again limited by the
>> >> >> disk. =A0I run it on my mac laptop for example.
>> >> >>
>> >> >> I have a patch that will allow a single JVM including zookeeper, b=
ut
>> >> >> it is locked up in my private git for now. This would get rid of t=
he
>> >> >> need to ssh localhost just to start local hbase.
>> >> >>
>> >> >> -ryan
>> >> >>
>> >> >> On Fri, Jan 15, 2010 at 1:22 PM, Seth Ladd wrote:
>> >> >> > I agree. =A0HBase in a box is essentially MySQL. =A0HBase is bui=
lt for
>> a
>> >> cluster.
>> >> >> >
>> >> >> > On Fri, Jan 15, 2010 at 11:17 AM, Andrew Purtell wrote:
>> >> >> >> On that scale, why not use MySQL or Postgres?
>> >> >> >>
>> >> >> >> "HBase in a box" is like "dynamic equilibrium", or "virtual
>> reality", or
>> >> >> >> "jumbo shrimp"... :-)
>> >> >> >>
>> >> >> >> =A0- Andy
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> ----- Original Message ----
>> >> >> >>> From: Otis Gospodnetic
>> >> >> >>> To: hbase-user@hadoop.apache.org
>> >> >> >>> Sent: Fri, January 15, 2010 12:54:42 PM
>> >> >> >>> Subject: HBase on 1 box? how big?
>> >> >> >>>
>> >> >> >>> Hello,
>> >> >> >>>
>> >> >> >>> I understand running HBase on a single box is kind of
>> >> >> >>> pointless (thanks Andrew Purtell for the reply about numbers o=
f
>> >> >> >>> boxes)... but I was wondering what kind of box might one need =
to
>> >> >> >>> host/run various HBase/Hadoop processes?
>> >> >> >>>
>> >> >> >>> Imagine I just need to have "HBase in a box", so to speak. :)
>> >> >> >>>
>> >> >> >>> I understand it depends on the volume on data, DB structure,
>> request
>> >> >> rates...
>> >> >> >>> I don't have those numbers, but say I want HBase to have 100M
>> rows with
>> >> >> >>> data from Apache logs and want to run the common web
>> analytics/stats
>> >> >> >>> reports on a nightly basis.
>> >> >> >>>
>> >> >> >>> * Would an EC2 Large Instance suffice?
>> >> >> >>> -- Large Instance 7.5 GB of memory, 4 EC2 Compute Units (2
>> virtual cores
>> >> >> >>> with 2 EC2 Compute Units each), 850 GB of local instance stora=
ge,
>> 64-bit
>> >> >> >>> platform
>> >> >> >>>
>> >> >> >>> * How about EC2 Small Instance?
>> >> >> >>> -- Small Instance (Default) 1.7 GB of memory, 1 EC2 Compute Un=
it
>> (1
>> >> virtual
>> >> >> core
>> >> >> >>> with 1 EC2 Compute Unit), 160 GB of local instance storage,
>> 32-bit
>> >> platform
>> >> >> >>>
>> >> >> >>> Thanks,
>> >> >> >>> Otis
>> >> >> >>> P.S.
>> >> >> >>> hw specs from http://aws.amazon.com/ec2/#instance
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >
>> >
>>
>