Return-Path: X-Original-To: apmail-hive-issues-archive@minotaur.apache.org Delivered-To: apmail-hive-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9D0651896E for ; Wed, 24 Jun 2015 06:57:43 +0000 (UTC) Received: (qmail 35784 invoked by uid 500); 24 Jun 2015 06:57:43 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 35762 invoked by uid 500); 24 Jun 2015 06:57:43 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 35722 invoked by uid 99); 24 Jun 2015 06:57:43 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Jun 2015 06:57:43 +0000 Date: Wed, 24 Jun 2015 06:57:43 +0000 (UTC) From: "Matt McCline (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Assigned] (HIVE-11051) Hive 1.2.0 MapJoin w/Tez - LazyBinaryArray cannot be cast to [Ljava.lang.Object; MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-11051?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline reassigned HIVE-11051: ----------------------------------- Assignee: Matt McCline (was: Gopal V) > Hive 1.2.0 MapJoin w/Tez - LazyBinaryArray cannot be cast to [Ljava.lang= .Object; > -------------------------------------------------------------------------= -------- > > Key: HIVE-11051 > URL: https://issues.apache.org/jira/browse/HIVE-11051 > Project: Hive > Issue Type: Bug > Components: Serializers/Deserializers, Tez > Affects Versions: 1.2.0 > Reporter: Greg Senia > Assignee: Matt McCline > Priority: Critical > Attachments: HIVE-11051.01.patch, problem_table_joins.tar.gz > > > I tried to apply: HIVE-10729 which did not solve the issue. > The following exception is thrown on a Tez MapJoin with Hive 1.2.0 and Te= z 0.5.4/0.5.3 > {code} > Status: Running (Executing on YARN cluster with App id application_143464= 1270368_1038) > -------------------------------------------------------------------------= ------- > VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED = KILLED > -------------------------------------------------------------------------= ------- > Map 1 .......... SUCCEEDED 3 3 0 0 0 = 0 > Map 2 ... FAILED 3 1 0 2 7 = 0 > -------------------------------------------------------------------------= ------- > VERTICES: 01/02 [=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>>--= -------] 66% ELAPSED TIME: 7.39 s =20 > -------------------------------------------------------------------------= ------- > Status: Failed > Vertex failed, vertexName=3DMap 2, vertexId=3Dvertex_1434641270368_1038_2= _01, diagnostics=3D[Task failed, taskId=3Dtask_1434641270368_1038_2_01_0000= 02, diagnostics=3D[TaskAttempt 0 failed, info=3D[Error: Failure while runni= ng task:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.= hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing = row {"cnctevn_id":"002245282386","svcrqst_id":"0000003627217285","svcrqst_c= rt_dts":"2015-04-23 11:54:39.238357","subject_seq_no":1,"plan_component":"H= MOM1 ","cust_segment":"RM ","cnctyp_cd":"001","cnctmd_cd":"D02","cnctev= s_cd":"007","svcrtyp_cd":"335","svrstyp_cd":"088","cmpltyp_cd":" ","catsrsn= _cd":" ","apealvl_cd":" ","cnstnty_cd":"001","svcrqst_asrqst_ind":"Y= ","svcrqst_rtnorig_in":"N","svcrqst_vwasof_dt":"null","sum_reason_cd":"98",= "sum_reason":"Exclude","crsr_master_claim_index":null,"svcrqct_cds":[" "]= ,"svcrqst_lupdt":"2015-04-23 22:14:01.288132","crsr_lupdt":null,"cntevsds_l= updt":"2015-04-23 11:54:40.740061","ignore_me":1,"notes":null} > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndR= unProcessor(TezProcessor.java:171) > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcess= or.java:137) > at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(Logic= alIOProcessorRuntimeTask.java:324) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1= .run(TezTaskRunner.java:176) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1= .run(TezTaskRunner.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroup= Information.java:1556) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.c= all(TezTaskRunner.java:168) > at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.c= all(TezTaskRunner.java:163) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata= .HiveException: Hive Runtime Error while processing row {"cnctevn_id":"0022= 45282386","svcrqst_id":"0000003627217285","svcrqst_crt_dts":"2015-04-23 11:= 54:39.238357","subject_seq_no":1,"plan_component":"HMOM1 ","cust_segmen= t":"RM ","cnctyp_cd":"001","cnctmd_cd":"D02","cnctevs_cd":"007","svcrtyp_cd= ":"335","svrstyp_cd":"088","cmpltyp_cd":" ","catsrsn_cd":" ","apealv= l_cd":" ","cnstnty_cd":"001","svcrqst_asrqst_ind":"Y","svcrqst_rtnorig_in":= "N","svcrqst_vwasof_dt":"null","sum_reason_cd":"98","sum_reason":"Exclude",= "crsr_master_claim_index":null,"svcrqct_cds":[" "],"svcrqst_lupdt":"2015-= 04-23 22:14:01.288132","crsr_lupdt":null,"cntevsds_lupdt":"2015-04-23 11:54= :40.740061","ignore_me":1,"notes":null} > at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(= MapRecordSource.java:91) > at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(= MapRecordSource.java:68) > at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapR= ecordProcessor.java:290) > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndR= unProcessor(TezProcessor.java:148) > ... 13 more > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime= Error while processing row {"cnctevn_id":"002245282386","svcrqst_id":"0000= 003627217285","svcrqst_crt_dts":"2015-04-23 11:54:39.238357","subject_seq_n= o":1,"plan_component":"HMOM1 ","cust_segment":"RM ","cnctyp_cd":"001","= cnctmd_cd":"D02","cnctevs_cd":"007","svcrtyp_cd":"335","svrstyp_cd":"088","= cmpltyp_cd":" ","catsrsn_cd":" ","apealvl_cd":" ","cnstnty_cd":"001"= ,"svcrqst_asrqst_ind":"Y","svcrqst_rtnorig_in":"N","svcrqst_vwasof_dt":"nul= l","sum_reason_cd":"98","sum_reason":"Exclude","crsr_master_claim_index":nu= ll,"svcrqct_cds":[" "],"svcrqst_lupdt":"2015-04-23 22:14:01.288132","crsr= _lupdt":null,"cntevsds_lupdt":"2015-04-23 11:54:40.740061","ignore_me":1,"n= otes":null} > at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator= .java:518) > at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(= MapRecordSource.java:83) > ... 16 more > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected e= xception: org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot b= e cast to [Ljava.lang.Object; > at org.apache.hadoop.hive.ql.exec.MapJoinOperator.process(MapJoin= Operator.java:426) > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:= 837) > at org.apache.hadoop.hive.ql.exec.FilterOperator.process(FilterOp= erator.java:122) > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:= 837) > at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(Table= ScanOperator.java:97) > at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(Ma= pOperator.java:162) > at org.apache.hadoop.hive.ql.exec.Map > {code} > To Recreate the issue: > {code} > import table service_request_clean from '/user/user/service_request_clea= n'; > import table ct_events_clean from '/user/user/ct_events_clean'; > drop table ct_events1_test; > create table ct_events1_test > as select a.*, > b.svcrqst_id, > b.svcrqct_cds, > b.svcrtyp_cd, > b.cmpltyp_cd, > b.sum_reason_cd as src, > b.cnctmd_cd, > b.notes > from ct_events_clean a > inner join > service_request_clean b > on a.contact_event_id =3D b.cnctevn_id; > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)