hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carl Steinbach (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1918) Add export/import facilities to the hive system
Date Fri, 21 Jan 2011 22:47:44 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12984981#action_12984981
] 

Carl Steinbach commented on HIVE-1918:
--------------------------------------

@Krishna: I tried applying the patch to trunk and running the tests. Noticed a couple things
upfront that need to be fixed:

* The patch doesn't apply cleanly with 'patch -p0'. To satisfy this using a Git repo you need
to generate the patch using 'git diff --no-prefix ...'
* Most of the new exim* tests fail with diffs. Can you please fix this and update the patch?
* 'hive.test.exim' needs to be added to HiveConf and hive-default.xml. There is already a
'hive.test.mode.*' namespace defined in HiveConf, so you should probably follow this convention
and change the name to 'hive.test.mode.exim'. I think an even better solution would be to
instead define a new conf property called 'hive.exim.uri.scheme.whitelist' and make it a comma
separated list of acceptable URI schemes for import and export.


> Add export/import facilities to the hive system
> -----------------------------------------------
>
>                 Key: HIVE-1918
>                 URL: https://issues.apache.org/jira/browse/HIVE-1918
>             Project: Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Krishna Kumar
>         Attachments: HIVE-1918.patch.txt
>
>
> This is an enhancement request to add export/import features to hive.
> With this language extension, the user can export the data of the table - which may be
located in different hdfs locations in case of a partitioned table - as well as the metadata
of the table into a specified output location. This output location can then be moved over
to another different hadoop/hive instance and imported there.  
> This should work independent of the source and target metastore dbms used; for instance,
between derby and mysql.
> For partitioned tables, the ability to export/import a subset of the partition must be
supported.
> Howl will add more features on top of this: The ability to create/use the exported data
even in the absence of hive, using MR or Pig. Please see http://wiki.apache.org/pig/Howl/HowlImportExport
for these details.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message