hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shreyas Joshi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-18066) Unable to insert data into S3 backed table from Hive
Date Tue, 14 Nov 2017 21:49:00 GMT
Shreyas Joshi created HIVE-18066:
------------------------------------

             Summary: Unable to insert data into S3 backed table from Hive
                 Key: HIVE-18066
                 URL: https://issues.apache.org/jira/browse/HIVE-18066
             Project: Hive
          Issue Type: Improvement
          Components: Hive
         Environment: Hive 1.2.0
Hadoop 2.6.0
HDFS
AWS- S3A
Debian jessie
            Reporter: Shreyas Joshi


I am trying to create a table and insert data into a table on S3 from Hive like:


{code:sql}
create table my_db.test_table (
userid int
) location   's3a://username:pass@bucket/s3-test/test-table'
{code}

This works, but when I try inserting data into this table like:

{code:sql}
INSERT INTO my_db.test_table VALUES (1);
{code}

It fails, and here's what I see:

{code}
hive> insert into test values (1);
-chgrp: '' does not match expected pattern for group
Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...
Failed with exception Wrong FS: s3a://username:pass@bucket/s3-test/test-table/.hive-staging_hive_2017-11-13_17-37-21_376_4109060838187898328-1/-ext-10002,
expected: hdfs://<ip-address>:<port>
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
{code}

The {{hdfs://<ip-address>:<port>}} in the error seems to be coming from the {{fs.default.name}}
setting in {{core-site.xml}}

If I insert data into the table via other other means, I can successfully query the table
from Hive. So, insertion not selection seems to be the problem. What might be happening here?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message