hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaobing Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE from external storage
Date Thu, 18 Sep 2014 17:56:34 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiaobing Zhou updated HIVE-7699:
--------------------------------
    Description: 
Hive is supposed to support loading data to table from external storage like Azure blob storage.
Here's an exampLe:
{noformat}
<property>
   <name>fs.azure.account.key.XXX.blob.core.windows.net</name>
   <value>CREDENTIAL-KEY</value>
</property> 
{noformat}
is configured into hadoop core-site.xml. bin/hadoop fs works, however if run the query like:
LOAD DATA INPATH 'wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt' OVERWRITE INTO
TABLE hivetable;

HIVE CLI will complain as
{noformat}
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.t
xt'': Move from: wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable
is not vali
d. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir"
do not conflict.
{noformat}

Stack trace:
{noformat}
	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
	at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
	at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
{noformat}

  was:
Hive is supposed to support loading data to table from external storage like Azure blob storage.
Here's an exampLe:
<property>
   <name>fs.azure.account.key.XXX.blob.core.windows.net</name>
   <value>CREDENTIAL-KEY</value>
</property> is configured into hadoop core-site.xml. bin/hadoop fs works, however if
run the query like:
LOAD DATA INPATH 'wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt' OVERWRITE INTO
TABLE hivetable;

HIVE CLI will complain as
FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.t
xt'': Move from: wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable
is not vali
d. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir"
do not conflict.

The stacktrace is 
	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
	at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
	at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)


> HIVE fails to LOAD DATA  INTO TABLE from external storage
> ---------------------------------------------------------
>
>                 Key: HIVE-7699
>                 URL: https://issues.apache.org/jira/browse/HIVE-7699
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Xiaobing Zhou
>            Assignee: Xiaobing Zhou
>
> Hive is supposed to support loading data to table from external storage like Azure blob
storage. Here's an exampLe:
> {noformat}
> <property>
>    <name>fs.azure.account.key.XXX.blob.core.windows.net</name>
>    <value>CREDENTIAL-KEY</value>
> </property> 
> {noformat}
> is configured into hadoop core-site.xml. bin/hadoop fs works, however if run the query
like:
> LOAD DATA INPATH 'wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt' OVERWRITE
INTO TABLE hivetable;
> HIVE CLI will complain as
> {noformat}
> FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.t
> xt'': Move from: wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable
is not vali
> d. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir"
do not conflict.
> {noformat}
> Stack trace:
> {noformat}
> 	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
> 	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
> 	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
> 	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
> 	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
> 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
> 	at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
> 	at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
> 	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
> 	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
> 	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message