hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nitin Pawar <nitinpawar...@gmail.com>
Subject Re: Creating partition with __HIVE_DEFAULT_PARTITION__ value
Date Mon, 23 Sep 2013 16:32:39 GMT
If  I understand correctly, this is what you are trying to do.

you have a data center where the data is written on a hive table (Data
center A)
you have another data center where you want to take backup of table from
data center A

you are using dist-cp to transfer data from data center A to B

if you are replicating data in exact same directories as they are in source
data center, easy option would be setting up meta store replication.




On Mon, Sep 23, 2013 at 8:18 PM, Ivan Kruglov <ivan.kruglov@booking.com>wrote:

> Hello to everyone,
>
> I'm working on the task of syncing data between two tables which have
> similar structure (read the same set of partitions). The tables are in
> different data centers and one table is a backup copy of another one. I'm
> trying to achieve this goal through distcp-ing data into target DC in
> temporary folder, recreating all needed partitions in target table and
> moving files from temporary place to final place. But I'm stuck on issue of
> creating partitions with value ' __HIVE_DEFAULT_PARTITION__'
>
> So, my question is: Is it possible in hive to manually create partition
> with '__HIVE_DEFAULT_PARTITION__' value?
>
> Neither of this way work:
> ALTER TABLE table ADD IF NOT EXISTS PARTITION (partition=);
> ALTER TABLE table ADD IF NOT EXISTS PARTITION (partition='');
> ALTER TABLE table ADD IF NOT EXISTS PARTITION
> (partition='__HIVE_DEFAULT_PARTITION__');
>
> Thank you.
> Ivan Kruglov.




-- 
Nitin Pawar

Mime
View raw message