Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of sahmed1020@gmail.com designates
 209.85.216.50 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAKYwJ9yVdODdod9Tq=-U6CYy5=zBn8pubHZ9dByGG3ZBoX3ijg@mail.gmail.com>
References: 
 <CAG2rwuNzF-hLcq7jBjueXOf6ZgFtqVrBeiSL7cZnUUOxgW1TdA@mail.gmail.com>
 <CBEF88C7.2D79C%doug.meil@explorysmedical.com>
 <CAKYwJ9yVdODdod9Tq=-U6CYy5=zBn8pubHZ9dByGG3ZBoX3ijg@mail.gmail.com>
From: S Ahmed <sahmed1020@gmail.com>
Date: Sun, 3 Jun 2012 15:21:54 -0400
Message-ID: 
 <CAG2rwuOP9mZPAFs2_-SS=OWDJh_np750LQ7wnHHXh8zaODXbfg@mail.gmail.com>
Subject: Re: how does hbase get the latest version with immutable hfiles?
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=20cf3071d1dcbc8cd304c196555a

--20cf3071d1dcbc8cd304c196555a
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Elliot,

Is there a video or slides?  I guess I have to register to view it?

On Sat, Jun 2, 2012 at 2:18 PM, Elliott Clark <eclark@stumbleupon.com>wrote=
:

> If you want to get into the really nitty gritty I found Lars' presentatio=
n
> really insightful.
>
> http://www.hbasecon.com/sessions/learning-hbase-internals/
>
> On Sat, Jun 2, 2012 at 6:13 AM, Doug Meil <doug.meil@explorysmedical.com
> >wrote:
>
> >
> > Hi there, I think you probably want to look at this=C5=A0
> >
> > Hbase catalog metadata=C5=A0
> >
> > http://hbase.apache.org/book.html#arch.catalog
> >
> > How data is stored internally=C5=A0
> >
> > http://hbase.apache.org/book.html#regions.arch
> >
> > Lots of versioning description here=C5=A0
> >
> > http://hbase.apache.org/book.html#datamodel
> >
> >
> >
> > Long story short, client talks directly to RegionServers, Hbase looks a=
t
> > multiple StoreFiles.
> >
> >
> >
> > On 6/1/12 4:27 PM, "S Ahmed" <sahmed1020@gmail.com> wrote:
> >
> > >(reference:
> > >http://www.larsgeorge.com/2009/10/hbase-architecture-101-storage.html)
> > >
> > >A row consists of a key, and column families, along with a timestamp.
> > >
> > >So for example:
> > >
> > >key =3D com.example.com/some/path
> > >
> > >cf: outboundlinks {
> > >      com.example.com/link1,
> > >     com.example.com/link2,
> > >     ..
> > >}
> > >
> > >Data is stored like this:
> > >
> > >Region Server -> Store -> StoreFile -> HFile
> > >
> > >Now when a client requests a particular key, the hmaster figures out
> which
> > >region server holds the data, this information is returned the client
> > >(which saves it locally), and then it makes a request to the region
> > >server.
> > >
> > >Now since the actual data files are immutable, if you modify a
> particular
> > >value in a CF, it is tombestombed (not sure how that works but
> understand
> > >it at a high level).
> > >
> > >So if I make a request for a given key, going with the example above, =
a
> > >particular url on the website example.com, and i want all the
> > >outboundlinks
> > >I reference the column family "outboudnlinks" which can store millions
> of
> > >urls.
> > >
> > >What process/service/class is in charge of assembling the various file=
s
> to
> > >get all the correct data?
> > >
> > >Summary of my question:
> > >What I am trying to understand is, if a particular CF has millions of
> > >values, and if a single value is mutated, a new file has to be created=
.
> > >So
> > >this means, if I query for that value i.e. it is included in my result
> > >set,
> > >how does hbase know where to look for the latest data?
> > >
> > >So basically from what I understand, making a get request for a
> particular
> > >key, cf will have to potentially look at more than one StoreFile (or
> > >HFile?) correct?
> >
> >
> >
>

--20cf3071d1dcbc8cd304c196555a--