hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carl Steinbach (JIRA)" <>
Subject [jira] Commented: (HIVE-1918) Add export/import facilities to the hive system
Date Fri, 21 Jan 2011 22:47:44 GMT


Carl Steinbach commented on HIVE-1918:

@Krishna: I tried applying the patch to trunk and running the tests. Noticed a couple things
upfront that need to be fixed:

* The patch doesn't apply cleanly with 'patch -p0'. To satisfy this using a Git repo you need
to generate the patch using 'git diff --no-prefix ...'
* Most of the new exim* tests fail with diffs. Can you please fix this and update the patch?
* 'hive.test.exim' needs to be added to HiveConf and hive-default.xml. There is already a
'hive.test.mode.*' namespace defined in HiveConf, so you should probably follow this convention
and change the name to 'hive.test.mode.exim'. I think an even better solution would be to
instead define a new conf property called 'hive.exim.uri.scheme.whitelist' and make it a comma
separated list of acceptable URI schemes for import and export.

> Add export/import facilities to the hive system
> -----------------------------------------------
>                 Key: HIVE-1918
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Krishna Kumar
>         Attachments: HIVE-1918.patch.txt
> This is an enhancement request to add export/import features to hive.
> With this language extension, the user can export the data of the table - which may be
located in different hdfs locations in case of a partitioned table - as well as the metadata
of the table into a specified output location. This output location can then be moved over
to another different hadoop/hive instance and imported there.  
> This should work independent of the source and target metastore dbms used; for instance,
between derby and mysql.
> For partitioned tables, the ability to export/import a subset of the partition must be
> Howl will add more features on top of this: The ability to create/use the exported data
even in the absence of hive, using MR or Pig. Please see
for these details.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message