Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of sahmed1020@gmail.com
 designates 209.85.216.41 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAPcDmSv2MEiSpQ-MvWH=xfKQFjezCeU9Ry6dw_8WJhP71JGiSQ@mail.gmail.com>
References: 
 <CAG2rwuOsGX2z_ry=hwfLfiO=Z59aEo32eHXNWtLq=YC4J1w7pA@mail.gmail.com>
 <CAPcDmSsGRPUrAJy2m1muqE3KZ6PdFtaFZy5nN2QZngEo5Of9bw@mail.gmail.com>
 <CAG2rwuOOLoGm0C5hEQ=_zypo_Zwb8FPQ6YGSMnt2m-rReXO+KA@mail.gmail.com>
 <CAPcDmSv2MEiSpQ-MvWH=xfKQFjezCeU9Ry6dw_8WJhP71JGiSQ@mail.gmail.com>
From: S Ahmed <sahmed1020@gmail.com>
Date: Tue, 29 May 2012 11:07:19 -0400
Message-ID: 
 <CAG2rwuOSD-Ozaa-1enjem7OKPyTqT6A-nK=b_B4=CNuhhD7d6g@mail.gmail.com>
Subject: Re: understanding the client code
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=20cf3071d1dc1bfe6a04c12e3222

--20cf3071d1dc1bfe6a04c12e3222
Content-Type: text/plain; charset=ISO-8859-1

I don't really want any, I just want to learn the internals :)

So why would someone not want to use the client, for data intensive tasks
like mapreduce etc. where they want direct access to the files?

On Tue, May 29, 2012 at 11:00 AM, N Keywal <nkeywal@gmail.com> wrote:

> There are two levels:
> - communication between hbase client and hbase cluster: this is the
> code you have in hbase client package. As a end user you don't really
> care, but you care if you want to learn hbase internals.
> - communication between customer code and hbase as a whole if you
> don't want to use the hbase client. Then several options are
> available, thrift being one of them (I'm not sure of avro status).
>
> What do you want to do exactly?
>
> On Tue, May 29, 2012 at 4:33 PM, S Ahmed <sahmed1020@gmail.com> wrote:
> > So how does thrift and avro fit into the picture?  (I believe I saw
> > references to that somewhere, are those alternate connection libs?)
> >
> > I know protobuf is just generating types for various languages...
> >
> > On Tue, May 29, 2012 at 10:26 AM, N Keywal <nkeywal@gmail.com> wrote:
> >
> >> Hi,
> >>
> >> If you're speaking about preparing the query it's in HTable and
> >> HConnectionManager.
> >> If you're on the pure network level, then, on trunk, it's now done
> >> with a third party called protobuf.
> >>
> >> See the code from HConnectionManager#createCallable to see how it's
> used.
> >>
> >> Cheers,
> >>
> >> N.
> >>
> >> On Tue, May 29, 2012 at 4:15 PM, S Ahmed <sahmed1020@gmail.com> wrote:
> >> > I'm looking at the client code here:
> >> >
> >>
> https://github.com/apache/hbase/tree/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/client
> >> >
> >> > Is this the high level operations, and the actual sending of this data
> >> over
> >> > the network is done somewhere else?
> >> >
> >> > For example, during a PUT, you may want it to write to n nodes, where
> is
> >> > the code that does that? And the actual network connection etc?
> >>
>

--20cf3071d1dc1bfe6a04c12e3222--