hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lefty Leverenz <leftylever...@gmail.com>
Subject Re: move hive tables from one cluster to another cluster
Date Tue, 04 Mar 2014 21:04:34 GMT
Here's the doc for "msck repair table" (or on EMR, "alter table recover
partitions"):
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE)
.

-- Lefty


On Fri, Feb 28, 2014 at 5:04 PM, Brad Ruderman <bruderman@radiumone.com>wrote:

> Hi, just want to give warning about export/import to different hive
> versions see this bug:
> https://issues.apache.org/jira/browse/HIVE-5318
>
> Thanks,
> Brad
>
>
> On Fri, Feb 28, 2014 at 1:55 PM, Edward Capriolo <edlinuxguru@gmail.com>wrote:
>
>> Hive also has export import utilities.
>>
>>
>> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport
>>
>> With hive thrift this should be fairly easy to script.
>>
>>
>> On Fri, Feb 28, 2014 at 4:53 PM, Stephen Sprague <spragues@gmail.com>wrote:
>>
>>> that advice is way over complicating something that is very easy.
>>> instead, please take this approach.
>>>
>>> 1. run the ddl to create the table on the new cluster
>>> 2. distcp the hdfs data into the appropriate hdfs directory.
>>> 3. run "msck repair table <table>" in hive to discover the partitions and
>>> populate the metastore accordingly.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Fri, Feb 28, 2014 at 1:41 PM, Abdelrahman Shettia <
>>> ashettia@hortonworks.com> wrote:
>>>
>>>> If you are using Mysql as a database, you need to take a mysql dump of
>>>> the metastore database and search/replace the old namenode hostname with
>>>> the new namenode hostname. Once that is completed, import the metastore
>>>> database.
>>>>
>>>> Thanks
>>>>
>>>>
>>>> On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv <
>>>> dwivedishashwat@gmail.com> wrote:
>>>>
>>>>> Where was your meta data in derby or MySql?
>>>>>
>>>>>
>>>>> *Warm Regards_**∞_*
>>>>> * Shashwat Shriparv*
>>>>>  [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]<http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9>[image:
>>>>> https://twitter.com/shriparv] <https://twitter.com/shriparv>[image:
>>>>> https://www.facebook.com/shriparv] <https://www.facebook.com/shriparv>[image:
>>>>> http://google.com/+ShashwatShriparv]<http://google.com/+ShashwatShriparv>[image:
>>>>> http://www.youtube.com/user/sShriparv/videos]<http://www.youtube.com/user/sShriparv/videos>[image:
>>>>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]<shriparv@yahoo.com>
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Feb 28, 2014 at 1:28 PM, soniya B <soniya.bigdata@gmail.com>wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I have moved warehouse file to another cluster. but still i didn't
>>>>>> see the tables on the other cluster. How to rebulid the metadata?
>>>>>>
>>>>>> Thanks
>>>>>> Soniya
>>>>>>
>>>>>> On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K <kkrishnan88@gmail.com>wrote:
>>>>>>
>>>>>>> 1. you can use distcp to copy the files to the new cluster
>>>>>>> 2. rebuild metadata
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Feb 27, 2014 at 8:07 PM, soniya B <soniya.bigdata@gmail.com>wrote:
>>>>>>>
>>>>>>>> Dear experts,
>>>>>>>>
>>>>>>>> I want to move my hive tables from one cluster to another
cluster.
>>>>>>>> how can i do it?
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Soniya.
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>> CONFIDENTIALITY NOTICE
>>>> NOTICE: This message is intended for the use of the individual or
>>>> entity to which it is addressed and may contain information that is
>>>> confidential, privileged and exempt from disclosure under applicable law.
>>>> If the reader of this message is not the intended recipient, you are hereby
>>>> notified that any printing, copying, dissemination, distribution,
>>>> disclosure or forwarding of this communication is strictly prohibited. If
>>>> you have received this communication in error, please contact the sender
>>>> immediately and delete it from your system. Thank You.
>>>
>>>
>>>
>>
>

Mime
View raw message