Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1B771200BCF for ; Mon, 5 Dec 2016 19:50:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 1A171160B09; Mon, 5 Dec 2016 18:50:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3DB40160B18 for ; Mon, 5 Dec 2016 19:49:59 +0100 (CET) Received: (qmail 2429 invoked by uid 500); 5 Dec 2016 18:49:58 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 2416 invoked by uid 99); 5 Dec 2016 18:49:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Dec 2016 18:49:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 4EC822C03DC for ; Mon, 5 Dec 2016 18:49:58 +0000 (UTC) Date: Mon, 5 Dec 2016 18:49:58 +0000 (UTC) From: =?utf-8?Q?Sergio_Pe=C3=B1a_=28JIRA=29?= To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-15361) Dynamic partition INSERT fails with a MoveTask failure MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 05 Dec 2016 18:50:00 -0000 [ https://issues.apache.org/jira/browse/HIVE-15361?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Pe=C3=B1a updated HIVE-15361: ------------------------------- Attachment: (was: HIVE-15361.1.patch) > Dynamic partition INSERT fails with a MoveTask failure > ------------------------------------------------------ > > Key: HIVE-15361 > URL: https://issues.apache.org/jira/browse/HIVE-15361 > Project: Hive > Issue Type: Bug > Components: Hive > Affects Versions: 2.2.0 > Reporter: Sergio Pe=C3=B1a > Assignee: Sergio Pe=C3=B1a > Priority: Critical > > {panel:title=3DRepro steps} > CREATE EXTERNAL TABLE external_1k0jU (name STRING, age INT) PARTITIONED = BY (country STRING, state STRING); > ALTER TABLE external_1k0jU ADD PARTITION (COUNTRY=3D'USA', STATE=3D'CA'); > INSERT INTO external_1k0jU PARTITION (country=3D'USA', state=3D'CA') valu= es ('John Doe', 23), ('Jane Doe', 22); > CREATE EXTERNAL TABLE external_P3kiT (name STRING, age INT) PARTITIONED = BY (country STRING, state STRING) location 's3a://hive-on-s3/foo/bar/'; > set hive.exec.dynamic.partition.mode=3Dnonstrict; > INSERT INTO TABLE external_P3kiT PARTITION (country, state) SELECT * FROM= external_1k0jU; > {panel} > {panel:title=3DError & stack trace} > ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hiv= e.ql.exec.MoveTask > INFO : MapReduce Jobs Launched:=20 > INFO : Stage-Stage-1: Map: 1 Cumulative CPU: 3.64 sec HDFS Read: 365= 6 HDFS Write: 99 SUCCESS > INFO : Total MapReduce CPU Time Spent: 3 seconds 640 msec > INFO : Completed executing command(queryId=3Dhive_20161201113939_d64df5d= 7-a4c4-4885-846f-10f0223fcf4c); Time taken: 23.227 seconds > Error: Error while processing statement: FAILED: Execution Error, return = code 1 from org.apache.hadoop.hive.ql.exec.MoveTask (state=3D08S01,code=3D1= ) > INFO : Loading data to table default.external_p3kit partition (country= =3Dnull, state=3Dnull) from s3a://hive-on-s3/foo/bar/.hive-staging_hive_201= 6-12-01_11-39-48_741_6724911837889341086-13/-ext-10002 > {code} > ERROR : Failed with exception MetaException(message:Invalid partition key= & values; keys [country, state, ], values []) > org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:I= nvalid partition key & values; keys [country, state, ], values []) > =09at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1902= ) > =09at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1834= ) > =09at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:142= 8) > =09at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:138= 8) > =09at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:453) > =09at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:214) > =09at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.= java:100) > =09at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1976) > =09at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1689) > =09at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1421) > =09at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1205) > =09at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1200) > =09at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOper= ation.java:237) > =09at org.apache.hive.service.cli.operation.SQLOperation.access$300(SQLOp= eration.java:88) > =09at org.apache.hive.service.cli.operation.SQLOperation$3$1.run(SQLOpera= tion.java:293) > =09at java.security.AccessController.doPrivileged(Native Method) > =09at javax.security.auth.Subject.doAs(Subject.java:415) > =09at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInfor= mation.java:1796) > =09at org.apache.hive.service.cli.operation.SQLOperation$3.run(SQLOperati= on.java:306) > =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:= 471) > =09at java.util.concurrent.FutureTask.run(FutureTask.java:262) > =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto= r.java:1145) > =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut= or.java:615) > =09at java.lang.Thread.run(Thread.java:745) > Caused by: MetaException(message:Invalid partition key & values; keys [co= untry, state, ], values []) > =09at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_partit= ion_with_auth_result$get_partition_with_auth_resultStandardScheme.read(Thri= ftHiveMetastore.java:65142) > =09at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_partit= ion_with_auth_result$get_partition_with_auth_resultStandardScheme.read(Thri= ftHiveMetastore.java:65119) > =09at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_partit= ion_with_auth_result.read(ThriftHiveMetastore.java:65050) > =09at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86= ) > =09at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.rec= v_get_partition_with_auth(ThriftHiveMetastore.java:2007) > =09at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get= _partition_with_auth(ThriftHiveMetastore.java:1990) > =09at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getPartitionWi= thAuthInfo(HiveMetaStoreClient.java:1210) > =09at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:43) > =09at java.lang.reflect.Method.invoke(Method.java:606) > =09at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(Ret= ryingMetaStoreClient.java:105) > =09at com.sun.proxy.$Proxy18.getPartitionWithAuthInfo(Unknown Source) > =09at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:43) > =09at java.lang.reflect.Method.invoke(Method.java:606) > =09at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHa= ndler.invoke(HiveMetaStoreClient.java:2032) > =09at com.sun.proxy.$Proxy18.getPartitionWithAuthInfo(Unknown Source) > =09at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1893= ) > =09... 23 more > {code} > {panel} -- This message was sent by Atlassian JIRA (v6.3.4#6332)