hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: hfile 9.4 to 9.6
Date Wed, 23 Jul 2014 01:46:41 GMT
Migrating to another cluster is for keeping service running non-stop ?

Please read http://hbase.apache.org/book.html#upgrade0.96

Cheers

On Jul 22, 2014, at 3:49 PM, Guangle Fan <fanguangle@gmail.com> wrote:

> Hi, Ted you are right,  hfiles on 0.94 cluster are v2 by default. I
> actually don't need the convert tool.
> 
> To migrate that data to another 0.96 cluster, does it work by copying over
> hfiles ? How to handle the meta data of the table in the new cluster ?
> 
> 
> On Tue, Jul 22, 2014 at 3:46 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> 
>> The subject of this thread says '9.4' - I assume you meant '0.94' release.
>> If so, please make correction in the subject.
>> 
>> Looking at hbase-default.xml from 0.94 branch:
>> 
>>  <property>
>>      <name>hfile.format.version</name>
>>      <value>2</value>
>>      <description>
>>          The HFile format version to use for new files. Set this to 1 to
>> test
>>          backwards-compatibility. The default value of this option should
>> be
>>          consistent with FixedFileTrailer.MAX_VERSION.
>>      </description>
>>  </property>
>> 
>> Are you running 0.94 cluster with the above config value being 1 ?
>> 
>> Cheers
>> 
>> On Tue, Jul 22, 2014 at 3:27 PM, Guangle Fan <fanguangle@gmail.com> wrote:
>> 
>>> Ted Thanks for your answer!
>>> 
>>> Actually that wouldn't convert automatically. The problem is 0.94 is
>> using
>>> hfileV1, and that is online cluster that I can't shut down and do hbase
>>> upgrade/check file, thus I can't convert the file to v2. The idea is copy
>>> over the hfilleV1 to another 0.96 cluster and convert to hfileV2. Any
>> handy
>>> tool there I can use to do the convert and hfile loading in the new
>>> cluster, or you guys have another way to handle this case ? Converting to
>>> sequence files ?
>>> 
>>> 
>>> On Tue, Jul 22, 2014 at 3:00 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>>> 
>>>> Guangle:
>>>> For 0.94 cluster, you can perform major compaction after which your
>>> HFiles
>>>> would be converted to HFileV2.
>>>> 
>>>> Cheers
>>>> 
>>>> 
>>>> On Tue, Jul 22, 2014 at 1:54 PM, Guangle Fan <fanguangle@gmail.com>
>>> wrote:
>>>> 
>>>>> Thanks Nick!
>>>>> For some reason, I can't do a in-place upgrading for the cluster. Is
>>>> there
>>>>> a tool there I can use to convert hfileV1 to hfileV2 ?
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> On Tue, Jul 22, 2014 at 1:43 PM, Nick Dimiduk <ndimiduk@gmail.com>
>>>> wrote:
>>>>> 
>>>>>> Hi Guangle,
>>>>>> 
>>>>>> Please have a look at the online book, there's a section on
>> upgrades.
>>>>> Also,
>>>>>> please consider upgrading to 0.98. The 0.96 line is in minimum
>>>>> maintenance
>>>>>> mode and 0.98 is considered the stable/production line.
>>>>>> 
>>>>>> http://hbase.apache.org/book.html#upgrading
>>>>>> 
>>>>>> Thanks,
>>>>>> Nick
>>>>>> 
>>>>>> 
>>>>>> On Tue, Jul 22, 2014 at 1:24 PM, Guangle Fan <fanguangle@gmail.com
>>> 
>>>>> wrote:
>>>>>> 
>>>>>>> Hi, All
>>>>>>> 
>>>>>>> I have hfiles in HBase 9.4 cluster that I want to migrate to
>> HBase
>>>> 9.6
>>>>>>> cluster.
>>>>>>> 
>>>>>>> What's the proper process to handle this ?
>>>>>>> 
>>>>>>> Regards,
>>>>>>> 
>>>>>>> Guangle
>> 

Mime
  • Unnamed multipart/alternative (inline, 7-Bit, 0 bytes)
View raw message