hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edward Capriolo <edlinuxg...@gmail.com>
Subject Re: Extract Create Table statement from Hive
Date Tue, 22 Feb 2011 18:13:24 GMT
On Tue, Feb 22, 2011 at 1:09 PM, Jay Ramadorai
<jramadorai@tripadvisor.com> wrote:
> Thank you, Ed. Trying it now, but I need the following package to build
> HiveUtil:
>
> com.media6.hive2rdbms.common.Hive2RdbmsConf;
>
> can you point me to where I can get it from?
>
> On Feb 22, 2011, at 10:51 AM, Edward Capriolo wrote:
>
> On Mon, Feb 21, 2011 at 7:31 PM, Edward Capriolo <edlinuxguru@gmail.com>
> wrote:
>
> On Mon, Feb 21, 2011 at 6:42 PM, Jay Ramadorai
>
> <jramadorai@tripadvisor.com> wrote:
>
> Does anyone have a way of generating the create table statement for a table
>
> that is in Hive?  I see a jira for
>
> this https://issues.apache.org/jira/browse/HIVE-967 and it appears that Ed
>
> Capriolo might have a solution for this. Ed, are you able to share this
>
> solution?
>
> My goal is to copy a bunch of Hive tables from one cluster to another. What
>
> I'd like to do is generate the DDL from one cluster and run it on the other,
>
> and then use DISTCP with lots of mappers to parallel-copy the table-data
>
> between the clusters. FYI, my metadata is in Derby. I could backup and
>
> restore the metadata directories but I dont want a copy of all the tables
>
> from the source database, only a subset.
>
> I tried Sqooping the table out of Hive, but it runs into :
>
> 11/02/21 18:23:50 ERROR manager.SqlManager: Error executing statement:
>
> java.sql.SQLException: Method not supported
>
> 11/02/21 18:23:50 ERROR sqoop.Sqoop: Got exception running Sqoop:
>
> java.lang.NullPointerException
>
> java.lang.NullPointerException
>
> at
>
> com.cloudera.sqoop.hive.TableDefWriter.getCreateTableStmt(TableDefWriter.java:133)
>
> Apparently the Hive Thrift jdbc driver doesnt support extracting table
>
> metadata.
>
> Please feel free to suggest alternative approaches.
>
> thanks
>
> Jay
>
>
> I do have some code that can generate DML. It is a separate problem
>
> that talks to the metastore (outside of the hive cli). I will throw
>
> the code up in the Jira tomorrow. However the plan for the Jira is to
>
> incorporate this in hive with a show create table.
>
>
> Jay,
>
> I uploaded my "show create table" program to
> https://issues.apache.org/jira/browse/HIVE-967.
>
> Caveats: This is a program you need to build against hive lib files.
> Caveats: There are edge cases where this will not produce the correct
> show table statement (hbase storage handler for example)
> Caveats: Does actually work though !
>
> Enjoy
>
>

That is just an artifact from the code i ripped it out of. From a
quick scan you should be able to remove those references. Contact me
off list if you are having issues.

Mime
View raw message