Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of theo.bertozzi@gmail.com
 designates 74.125.82.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CADcMMgGWcTtJ5xKnGOnSC6eoeKN-ADhELtO_xy7GqihrEAO2+A@mail.gmail.com>
References: 
 <CAHXxaiC9RUc2b6kJmbArf+WAeUHBjC2FAwsFDxc5Hcd3W_Ncxw@mail.gmail.com>
 <CADcMMgHseqU1431fWt7dX9Om_mj8wVYBZc6+Wuz=rKgT1=JBnQ@mail.gmail.com>
 <CAMUu0w9xuMhUv=x47hD=tyZQPu_=o4n47h_4_uUGzNkGrdYfkA@mail.gmail.com>
 <CAHXxaiBJ2jzh9fKA0+VNDZbFcaPsyBP9sDpQSdxjb7G1tSj8Qg@mail.gmail.com>
 <CAMUu0w9UNh_7__gDzetd9LMuCUA_bbADJ=dp=gYZNm9MR1dmKA@mail.gmail.com>
 <CADcMMgFf+PBe25PisoFD2VMTc0P4chRoG8NyL2XUE9jOUB-sPA@mail.gmail.com>
 <CAFb6HiLy9dehxs2JB7xNHMb5mKvBq4Ph9Lbh7a=c2EVFvWGGWQ@mail.gmail.com>
 <CADcMMgGWcTtJ5xKnGOnSC6eoeKN-ADhELtO_xy7GqihrEAO2+A@mail.gmail.com>
From: Matteo Bertozzi <theo.bertozzi@gmail.com>
Date: Thu, 7 Mar 2013 23:09:22 +0000
Message-ID: 
 <CAFb6HiJAv8dpO=mt0_dp+sMP9saY-mo=xMyXHPGeKWuX5xFjvg@mail.gmail.com>
Subject: Re: reason to do major compaction after split
To: dev@hbase.apache.org
Content-Type: multipart/alternative; boundary=f46d044282484495e504d75dcd8c

--f46d044282484495e504d75dcd8c
Content-Type: text/plain; charset=ISO-8859-1

On Thu, Mar 7, 2013 at 10:56 PM, Stack <stack@duboce.net> wrote:

> Any ideas on what migration from current format to the above would be like
> Matteo?  We'd read current layout, use it to populate a files table, new
> files would be written to a the new /hbase/data/ dir, and for a while we'd
> span the old and new locations?
>

If you have the possibility to shutdown the whole cluster, the way is easy
move all the hfiles in /hbase/data and populate the "files table".

If you can't, you just have to keep the current code able to been able read
the current fs layout and archiving
if there's something in that directory reads from that as today if not goes
to the file table.
on write (flush compactions) adds the new file to the "files table" and
/hbase/data

--f46d044282484495e504d75dcd8c--