hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pun Intended <punintende...@gmail.com>
Subject hive error when trying to write data to s3n
Date Tue, 04 Aug 2015 19:19:02 GMT
Hello,

I have a query that used to work fine previously. I am testing on hive 1.1
now and it is failing. The AWS access and secret key have permissions to
read and write data to this directory. The directory exists.

hive -e " insert overwrite directory
's3n://<access_key>:<secret_key>@my_bucket/a/b/2015-07-30' SELECT * FROM
my_table WHERE date='2015-07-30';"

The errors that I get are:

1) I believe this is a non-critical error by reading the hive archives.
Logging initialized using configuration in
jar:file:/opt/cloudera/parcels/CDH-5.4.3-1.cdh5.4.3.p0.6/jars/hive-common-1.1.0-cdh5.4.3.jar!/hive-log4j.properties
-chgrp: '' does not match expected pattern for group
Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...


2) This, I believe is critical and the query fails:
Moving data to:
s3n://<access_key>:<secret_key>@my_bucket/a/b/2015-07-30/.hive-staging_hive_2015-08-04_18-38-47_649_1476668515119011800-1/-ext-10000
Failed with exception Wrong FS:
s3n://<access_key>:<secret_key>@my_bucket/a/b/2015-07-30/.hive-staging_hive_2015-08-04_18-38-47_649_1476668515119011800-1/-ext-10002,
expected: hdfs://somemachine.qe1.blah.com:8020
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.MoveTask


Do you have any advice how I can fix this? Is this a known issue?

Thanks!
--py

Mime
View raw message