Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of burley@geek.net designates
 74.125.149.209 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAN-Wa6q_p_afQUO59-1YFf7p-qYqU2JaQkFC3+pgc_z9S1Xt6A@mail.gmail.com>
References: 
 <CAN-Wa6rucRKTyUcisCgFvRQRvrH26-4tVh=oh_XQucb3VHGhwQ@mail.gmail.com>
	<CAN-Wa6q_p_afQUO59-1YFf7p-qYqU2JaQkFC3+pgc_z9S1Xt6A@mail.gmail.com>
Date: Sun, 21 Aug 2011 21:51:00 -0400
Message-ID: 
 <CADJrLerO6GbHYYX8oVAito31j-6T8UP-dUm=gg1b5J5FCEZ_OA@mail.gmail.com>
Subject: Re: Alter table Set Locations for all partitions
From: David Burley <david@geek.net>
To: user@hive.apache.org
Content-Type: text/plain; charset=ISO-8859-1

Bhupesh,

The following worked for us on a MySQL metastore:

mysqldump metastore > metastore-backup-`date +%Y%m%d`.sql
mysql metastore
UPDATE SDS SET LOCATION=REPLACE(LOCATION, 'hdfs://hadoop-namenode-1',
'hdfs://hadoop-namenode-2');
UPDATE DBS SET `DESC`=REPLACE(`DESC`, 'hdfs://hadoop-namenode-1',
'hdfs://hadoop-namenode-2');

But I think you noted you are using Derby. If I were using Derby, I'd
switch to MySQL to make the management less painful, and then do the
above. I provided some info on migrating from Derby to MySQL here:

http://search-hadoop.com/m/J15J0FwAg1/v=plain

If you must run Derby -- I'd think you could use the same tool,
RazorSQL to load up the metastore and then tweak the underlying data.

Good Luck!

--David

On Fri, Aug 19, 2011 at 5:26 PM, Bhupesh Bansal <bhupesh@groupon.com> wrote:
> Hey Folks,
>
> I am wondering what is the easiest way to migrate data off one hadoop/hive
> cluster to another.
>
> I distcp all data to new cluster, and then copied the metadata directory to
> new cluster.
> hive comes up fine and show tables etc but the hive location is still
> pointing to old cluster
>
> There is one command
> alter table table_name set location new_location
>
> but it doesnt work for partitioned tables, is there a way we can do it for
> *ALL* partitions easily ??
>
> Best
> Bhupesh
>
>
>
====
This e- mail message is intended only for the named recipient(s) above. It may contain confidential and privileged information. If you are not the intended recipient you are hereby notified that any dissemination, distribution or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. Thank you.