Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Tue, 14 Nov 2017 21:49:00 +0000 (UTC)
From: "Shreyas Joshi (JIRA)" <jira@apache.org>
To: dev@hive.apache.org
Message-ID: <JIRA.13118378.1510696110000.238558.1510696140125@Atlassian.JIRA>
In-Reply-To: <JIRA.13118378.1510696110000@Atlassian.JIRA>
References: <JIRA.13118378.1510696110000@Atlassian.JIRA> <JIRA.13118378.1510696110210@jira-lw-us.apache.org>
Subject: [jira] [Created] (HIVE-18066) Unable to insert data into S3 backed
 table from Hive
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 14 Nov 2017 21:49:05 -0000

Shreyas Joshi created HIVE-18066:
------------------------------------

             Summary: Unable to insert data into S3 backed table from Hive
                 Key: HIVE-18066
                 URL: https://issues.apache.org/jira/browse/HIVE-18066
             Project: Hive
          Issue Type: Improvement
          Components: Hive
         Environment: Hive 1.2.0
Hadoop 2.6.0
HDFS
AWS- S3A
Debian jessie
            Reporter: Shreyas Joshi


I am trying to create a table and insert data into a table on S3 from Hive like:


{code:sql}
create table my_db.test_table (
userid int
) location   's3a://username:pass@bucket/s3-test/test-table'
{code}

This works, but when I try inserting data into this table like:

{code:sql}
INSERT INTO my_db.test_table VALUES (1);
{code}

It fails, and here's what I see:

{code}
hive> insert into test values (1);
-chgrp: '' does not match expected pattern for group
Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...
Failed with exception Wrong FS: s3a://username:pass@bucket/s3-test/test-table/.hive-staging_hive_2017-11-13_17-37-21_376_4109060838187898328-1/-ext-10002, expected: hdfs://<ip-address>:<port>
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
{code}

The {{hdfs://<ip-address>:<port>}} in the error seems to be coming from the {{fs.default.name}} setting in {{core-site.xml}}

If I insert data into the table via other other means, I can successfully query the table from Hive. So, insertion not selection seems to be the problem. What might be happening here?


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)