hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <shouvanik.hal...@accenture.com>
Subject RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely
Date Fri, 06 Sep 2013 20:59:31 GMT
Hi ,

I tried to set the parameters inside hive-site.xml on the node from where I am running hive.
Even "hive>set;" command showed me that the parameters were successfully set. Yet, when
running hive "CREATE EXTERNAL TABLE...", I am getting the following error

FAILED: Error in metadata: MetaException(message:java.lang.IllegalArgumentException: AWS Access
Key ID and Secret Access Key must be specified as the username or password (respectively)
of a s3n URL, or by setting the fs.s3n.awsAccessKeyId or fs.s3n.awsSecretAccessKey properties
(respectively).)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask


Please help.

Thanks,
Shouvanik

From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Saturday, September 07, 2013 2:25 AM
To: user@hive.apache.org
Subject: Re: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

did you try setting them in hive-site.xml file ?

On Sat, Sep 7, 2013 at 2:18 AM, <shouvanik.haldar@accenture.com<mailto:shouvanik.haldar@accenture.com>>
wrote:
Hi,

Can anybody please reply to this below? I am stuck up very bad.

Regards,
Shouvanik

From: Haldar, Shouvanik
Sent: Friday, September 06, 2013 11:22 PM
To: user@hive.apache.org<mailto:user@hive.apache.org>
Subject: RE: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi,

Is it possible to permanently set the below parameters? Please help.

Thanks,
SHouvanik

From: Jitendra Yadav [mailto:jeetuyadav200890@gmail.com]
Sent: Thursday, September 05, 2013 6:02 PM

To: user@hive.apache.org<mailto:user@hive.apache.org>
Subject: Re: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

OK got your point, As an alternative you can set these variables in hive environment before
creating the table

Hive > set fs.s3n.awsSecretAccessKey='value'
Hive > set fs.s3n.awsAccessKeyId='Value'

Hope this will help you.

Thanks
Jitendra
On Thu, Sep 5, 2013 at 5:19 PM, <shouvanik.haldar@accenture.com<mailto:shouvanik.haldar@accenture.com>>
wrote:
Hi,

Thanks for the reply.

I had seen in some posts, that you could mention these keys on the Hive CLI. If things work,
then I am later planning to include it in core-site.xml of Hadoop config. Presently, I am
not allowed to restart Hadoop services.

"create external table ....
.....
LOCATION 's3n:// <fs.s3n.awsAccessKeyId: fs.s3n>.<awsSecretAccessKey >@ap-hw-dev/service-names';

Please help me.

Thanks,
Shouvanik

From: Jitendra Yadav [mailto:jeetuyadav200890@gmail.com<mailto:jeetuyadav200890@gmail.com>]
Sent: Thursday, September 05, 2013 5:11 PM
To: user@hive.apache.org<mailto:user@hive.apache.org>
Subject: Re: error executing the tutorial -> https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

Hi,

Did you configured fs.s3n.awsAccessKeyId or fs.s3n.awsSecretAccessKey properties
in your core-site.xml file?

Regards
Jitendra
On Thu, Sep 5, 2013 at 3:52 PM, <shouvanik.haldar@accenture.com<mailto:shouvanik.haldar@accenture.com>>
wrote:
Hi,

I am executing the example, but got initial roadblock while trying out "Setting up tables
(DDL Statements)" section.

When I executed the command "hive> create external table kv (key int, values string)  location
's3n://data.s3ndemo.hive/kv';"

I got the error

FAILED: Error in metadata: MetaException(message:java.lang.IllegalArgumentException: AWS Access
Key ID and Secret Access Key must be specified as the username or password (respectively)
of a s3n URL, or by setting the fs.s3n.awsAccessKeyId or fs.s3n.awsSecretAccessKey properties
(respectively).)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
hive>

Please help.


Thanks,
Shouvanik

________________________________
This message is for the designated recipient only and may contain privileged, proprietary,
or otherwise confidential information. If you have received it in error, please notify the
sender immediately and delete the original. Any other use of the e-mail by you is prohibited.

Where allowed by local law, electronic communications with Accenture and its affiliates, including
e-mail and instant messaging (including content), may be scanned by our systems for the purposes
of information security and assessment of internal compliance with Accenture policy.

______________________________________________________________________________________

www.accenture.com<http://www.accenture.com/>





--
Nitin Pawar

Mime
View raw message