hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Qiang Tian <tian...@gmail.com>
Subject Re: hfile 9.4 to 9.6
Date Wed, 23 Jul 2014 02:01:15 GMT
what about snapshot?


On Wed, Jul 23, 2014 at 7:49 AM, Guangle Fan <fanguangle@gmail.com> wrote:

> Hi, Ted you are right,  hfiles on 0.94 cluster are v2 by default. I
> actually don't need the convert tool.
>
> To migrate that data to another 0.96 cluster, does it work by copying over
> hfiles ? How to handle the meta data of the table in the new cluster ?
>
>
> On Tue, Jul 22, 2014 at 3:46 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > The subject of this thread says '9.4' - I assume you meant '0.94'
> release.
> > If so, please make correction in the subject.
> >
> > Looking at hbase-default.xml from 0.94 branch:
> >
> >   <property>
> >       <name>hfile.format.version</name>
> >       <value>2</value>
> >       <description>
> >           The HFile format version to use for new files. Set this to 1 to
> > test
> >           backwards-compatibility. The default value of this option
> should
> > be
> >           consistent with FixedFileTrailer.MAX_VERSION.
> >       </description>
> >   </property>
> >
> > Are you running 0.94 cluster with the above config value being 1 ?
> >
> > Cheers
> >
> > On Tue, Jul 22, 2014 at 3:27 PM, Guangle Fan <fanguangle@gmail.com>
> wrote:
> >
> > > Ted Thanks for your answer!
> > >
> > > Actually that wouldn't convert automatically. The problem is 0.94 is
> > using
> > > hfileV1, and that is online cluster that I can't shut down and do hbase
> > > upgrade/check file, thus I can't convert the file to v2. The idea is
> copy
> > > over the hfilleV1 to another 0.96 cluster and convert to hfileV2. Any
> > handy
> > > tool there I can use to do the convert and hfile loading in the new
> > > cluster, or you guys have another way to handle this case ? Converting
> to
> > > sequence files ?
> > >
> > >
> > > On Tue, Jul 22, 2014 at 3:00 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> > >
> > > > Guangle:
> > > > For 0.94 cluster, you can perform major compaction after which your
> > > HFiles
> > > > would be converted to HFileV2.
> > > >
> > > > Cheers
> > > >
> > > >
> > > > On Tue, Jul 22, 2014 at 1:54 PM, Guangle Fan <fanguangle@gmail.com>
> > > wrote:
> > > >
> > > > > Thanks Nick!
> > > > > For some reason, I can't do a in-place upgrading for the cluster.
> Is
> > > > there
> > > > > a tool there I can use to convert hfileV1 to hfileV2 ?
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Tue, Jul 22, 2014 at 1:43 PM, Nick Dimiduk <ndimiduk@gmail.com>
> > > > wrote:
> > > > >
> > > > > > Hi Guangle,
> > > > > >
> > > > > > Please have a look at the online book, there's a section on
> > upgrades.
> > > > > Also,
> > > > > > please consider upgrading to 0.98. The 0.96 line is in minimum
> > > > > maintenance
> > > > > > mode and 0.98 is considered the stable/production line.
> > > > > >
> > > > > > http://hbase.apache.org/book.html#upgrading
> > > > > >
> > > > > > Thanks,
> > > > > > Nick
> > > > > >
> > > > > >
> > > > > > On Tue, Jul 22, 2014 at 1:24 PM, Guangle Fan <
> fanguangle@gmail.com
> > >
> > > > > wrote:
> > > > > >
> > > > > > > Hi, All
> > > > > > >
> > > > > > > I have hfiles in HBase 9.4 cluster that I want to migrate
to
> > HBase
> > > > 9.6
> > > > > > > cluster.
> > > > > > >
> > > > > > > What's the proper process to handle this ?
> > > > > > >
> > > > > > > Regards,
> > > > > > >
> > > > > > > Guangle
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message