hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15856) Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a
Date Thu, 09 Feb 2017 20:36:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860153#comment-15860153
] 

Sahil Takiar commented on HIVE-15856:
-------------------------------------

[~zyork] it seems that HIVE-13463 fixes issues when trying to import across filesystems, but
in order for an export / import command to run against a filesystem, the scheme of the filesystem
uri must be in the list {{hive.exim.uri.scheme.whitelist}} - currently there are no S3 schemes
in that list.

At least, the following query fails:

{quote}
export table src to '${hiveconf:test.blobstore.path.unique}/exim/src';
{quote}

with the following exception:

{quote}
org.apache.hadoop.hive.ql.parse.SemanticException: Invalid path only the following file systems
accepted for export/import : hdfs,pfile,file
	at org.apache.hadoop.hive.ql.parse.EximUtil.getValidatedURI(EximUtil.java:187)
	at org.apache.hadoop.hive.ql.parse.ExportSemanticAnalyzer.analyzeInternal(ExportSemanticAnalyzer.java:73)
	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:514)
	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1319)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1459)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1239)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1229)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336)
...
{quote}

> Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a
> ------------------------------------------------------------------
>
>                 Key: HIVE-15856
>                 URL: https://issues.apache.org/jira/browse/HIVE-15856
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>
> Add support for export / import operations on S3.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message