Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com
 designates 209.85.213.50 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALeQDOGK=7so7UmrWASSgMtaKPnjUmhdcpwnfc_KOKmMgUiHKQ@mail.gmail.com>
References: 
 <CALte62yQ4Qc6z-jM7Z+F_PHsEN46cYh=v7pKpJY_NtgFEELcRg@mail.gmail.com>
	<CALeQDOHX--9MgBhmfwNNfLzh2O+8bi1w=fBy+FEq_vThG491zg@mail.gmail.com>
	<CAMZUsP7Qb-rv34Fvs5r1Ss6v6b0F5TYBe=_OtyOfAaZ20eO7fQ@mail.gmail.com>
	<CALte62w+PUSkbv9PhYthTG3UvLUUxky8LTWtnyod=sudhon7=A@mail.gmail.com>
	<CALeQDOGK=7so7UmrWASSgMtaKPnjUmhdcpwnfc_KOKmMgUiHKQ@mail.gmail.com>
Date: Wed, 23 Jul 2014 18:03:48 -0700
Message-ID: 
 <CALte62zNeFw9ek78TZhFk3W9Pc_3xE65T4dM7bUjNWOptnMQiw@mail.gmail.com>
Subject: Re: hfile 9.4 to 9.6
From: Ted Yu <yuzhihong@gmail.com>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=047d7b5d61e481f0d404fee6070e

--047d7b5d61e481f0d404fee6070e
Content-Type: text/plain; charset=UTF-8

Please take a look at:
HBASE-9360 Enable 0.94 -> 0.96 replication to minimize upgrade down time

Cheers


On Wed, Jul 23, 2014 at 10:12 AM, Guangle Fan <fanguangle@gmail.com> wrote:

> Not as described in the instruction page shutting down the cluster and do
> in-place upgrading. Yes, the process is to migrate table to another cluster
> without service downtime. The other cluster is already 0.96. How is the
> process of doing migration ?
>
>
> On Tue, Jul 22, 2014 at 7:34 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > You mean the snapshot(s) taken by the 0.94.x release ?
> > 0.98 release is fully compatible in snapshot directory structure with
> that
> > of 0.94
> >
> > Cheers
> >
> >
> > On Tue, Jul 22, 2014 at 7:01 PM, Qiang Tian <tianq01@gmail.com> wrote:
> >
> > > what about snapshot?
> > >
> > >
> > > On Wed, Jul 23, 2014 at 7:49 AM, Guangle Fan <fanguangle@gmail.com>
> > wrote:
> > >
> > > > Hi, Ted you are right,  hfiles on 0.94 cluster are v2 by default. I
> > > > actually don't need the convert tool.
> > > >
> > > > To migrate that data to another 0.96 cluster, does it work by copying
> > > over
> > > > hfiles ? How to handle the meta data of the table in the new cluster
> ?
> > > >
> > > >
> > > > On Tue, Jul 22, 2014 at 3:46 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> > > >
> > > > > The subject of this thread says '9.4' - I assume you meant '0.94'
> > > > release.
> > > > > If so, please make correction in the subject.
> > > > >
> > > > > Looking at hbase-default.xml from 0.94 branch:
> > > > >
> > > > >   <property>
> > > > >       <name>hfile.format.version</name>
> > > > >       <value>2</value>
> > > > >       <description>
> > > > >           The HFile format version to use for new files. Set this
> to
> > 1
> > > to
> > > > > test
> > > > >           backwards-compatibility. The default value of this option
> > > > should
> > > > > be
> > > > >           consistent with FixedFileTrailer.MAX_VERSION.
> > > > >       </description>
> > > > >   </property>
> > > > >
> > > > > Are you running 0.94 cluster with the above config value being 1 ?
> > > > >
> > > > > Cheers
> > > > >
> > > > > On Tue, Jul 22, 2014 at 3:27 PM, Guangle Fan <fanguangle@gmail.com
> >
> > > > wrote:
> > > > >
> > > > > > Ted Thanks for your answer!
> > > > > >
> > > > > > Actually that wouldn't convert automatically. The problem is 0.94
> > is
> > > > > using
> > > > > > hfileV1, and that is online cluster that I can't shut down and do
> > > hbase
> > > > > > upgrade/check file, thus I can't convert the file to v2. The idea
> > is
> > > > copy
> > > > > > over the hfilleV1 to another 0.96 cluster and convert to hfileV2.
> > Any
> > > > > handy
> > > > > > tool there I can use to do the convert and hfile loading in the
> new
> > > > > > cluster, or you guys have another way to handle this case ?
> > > Converting
> > > > to
> > > > > > sequence files ?
> > > > > >
> > > > > >
> > > > > > On Tue, Jul 22, 2014 at 3:00 PM, Ted Yu <yuzhihong@gmail.com>
> > wrote:
> > > > > >
> > > > > > > Guangle:
> > > > > > > For 0.94 cluster, you can perform major compaction after which
> > your
> > > > > > HFiles
> > > > > > > would be converted to HFileV2.
> > > > > > >
> > > > > > > Cheers
> > > > > > >
> > > > > > >
> > > > > > > On Tue, Jul 22, 2014 at 1:54 PM, Guangle Fan <
> > fanguangle@gmail.com
> > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > Thanks Nick!
> > > > > > > > For some reason, I can't do a in-place upgrading for the
> > cluster.
> > > > Is
> > > > > > > there
> > > > > > > > a tool there I can use to convert hfileV1 to hfileV2 ?
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Tue, Jul 22, 2014 at 1:43 PM, Nick Dimiduk <
> > > ndimiduk@gmail.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi Guangle,
> > > > > > > > >
> > > > > > > > > Please have a look at the online book, there's a section on
> > > > > upgrades.
> > > > > > > > Also,
> > > > > > > > > please consider upgrading to 0.98. The 0.96 line is in
> > minimum
> > > > > > > > maintenance
> > > > > > > > > mode and 0.98 is considered the stable/production line.
> > > > > > > > >
> > > > > > > > > http://hbase.apache.org/book.html#upgrading
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Nick
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Jul 22, 2014 at 1:24 PM, Guangle Fan <
> > > > fanguangle@gmail.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi, All
> > > > > > > > > >
> > > > > > > > > > I have hfiles in HBase 9.4 cluster that I want to migrate
> > to
> > > > > HBase
> > > > > > > 9.6
> > > > > > > > > > cluster.
> > > > > > > > > >
> > > > > > > > > > What's the proper process to handle this ?
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > >
> > > > > > > > > > Guangle
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

--047d7b5d61e481f0d404fee6070e--