From issues-return-141508-archive-asf-public=cust-asf.ponee.io@hive.apache.org Wed Oct 31 18:48:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id ABB4418065D for ; Wed, 31 Oct 2018 18:48:04 +0100 (CET) Received: (qmail 21193 invoked by uid 500); 31 Oct 2018 17:48:03 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 21184 invoked by uid 99); 31 Oct 2018 17:48:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 Oct 2018 17:48:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 2C6CB194F82 for ; Wed, 31 Oct 2018 17:48:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.501 X-Spam-Level: X-Spam-Status: No, score=-109.501 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id P06X45n8Vou6 for ; Wed, 31 Oct 2018 17:48:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 516975F54A for ; Wed, 31 Oct 2018 17:48:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 85E88E13DA for ; Wed, 31 Oct 2018 17:48:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 3D30627765 for ; Wed, 31 Oct 2018 17:48:00 +0000 (UTC) Date: Wed, 31 Oct 2018 17:48:00 +0000 (UTC) From: "Jason Dere (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-20839) "Cannot find field" error during dynamically partitioned hash join MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-20839?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-20839: ------------------------------ Status: Patch Available (was: In Progress) > "Cannot find field" error during dynamically partitioned hash join > ------------------------------------------------------------------ > > Key: HIVE-20839 > URL: https://issues.apache.org/jira/browse/HIVE-20839 > Project: Hive > Issue Type: Bug > Components: Query Processor > Reporter: Jason Dere > Assignee: Jason Dere > Priority: Major > Attachments: HIVE-20839.1.patch, HIVE-20839.2.patch > > > Occurs in some cases in the non-CBO optimized queries, either if CBO is d= isabled or has failed due to error. > {noformat} > 2018-10-11T04:40:22,724 ERROR [TezTR-85144_8944_1085_28_996_2 (1539092085= 144_8944_1085_28_000996_2)] tez.ReduceRecordProcessor: Hit error while clos= ing operators - failing tree > 2018-10-11T04:40:22,724 ERROR [TezTR-85144_8944_1085_28_996_2 (1539092085= 144_8944_1085_28_000996_2)] tez.TezProcessor: java.lang.RuntimeException: c= annot find field _col304 from [0:_col0, 1:_col1, 2:_col2, 3:_col3, 4:_col4,= 5:_col5, 6:_col6, 7:_col7, 8:_col8, 9:_col9, 10:_col10, 11:_col11, 12:_col= 12, 13:_col13, 14:_col15, 15:_col16, 16:_col17, 17:_col18, 18:_col19, 19:_c= ol20, 20:_col21, 21:_col22, 22:_col23, 23:_col24, 24:_col25, 25:_col26, 26:= _col27, 27:_col28, 28:_col29, 29:_col30, 30:_col31, 31:_col32, 32:_col33, 3= 3:_col34, 34:_col35, 35:_col36, 36:_col37, 37:_col38, 38:_col39, 39:_col40,= 40:_col41, 41:_col42, 42:_col43, 43:_col44, 44:_col45, 45:_col46, 46:_col4= 7, 47:_col48, 48:_col49, 49:_col50, 50:_col51, 51:_col52, 52:_col53, 53:_co= l54, 54:_col55, 55:_col56, 56:_col57, 57:_col58, 58:_col59, 59:_col60, 60:_= col61, 61:_col62, 62:_col63, 63:_col64, 64:_col65, 65:_col66, 66:_col67, 67= :_col68, 68:_col70, 69:_col72, 70:_col73, 71:_col74, 72:_col75, 73:_col76, = 74:_col77, 75:_col78, 76:_col79, 77:_col80, 78:_col81, 79:_col82, 80:_col83= , 81:_col84, 82:_col85, 83:_col86, 84:_col87, 85:_col88, 86:_col89, 87:_col= 90, 88:_col91, 89:_col92, 90:_col93, 91:_col94, 92:_col95, 93:_col96, 94:_c= ol97, 95:_col98, 96:_col99, 97:_col100, 98:_col101, 99:_col102, 100:_col103= , 101:_col104, 102:_col105, 103:_col106, 104:_col107, 105:_col108, 106:_col= 109, 107:_col110, 108:_col111, 109:_col112, 110:_col113, 111:_col114, 112:_= col115, 113:_col116, 114:_col117, 115:_col118, 116:_col119, 117:_col120, 11= 8:_col121, 119:_col122, 120:_col123, 121:_col124, 122:_col125, 123:_col126,= 124:_col127, 125:_col128, 126:_col129, 127:_col130, 128:_col131, 129:_col1= 32, 130:_col133, 131:_col134, 132:_col135, 133:_col136, 134:_col137, 135:_c= ol138, 136:_col139, 137:_col140, 138:_col141, 139:_col142, 140:_col143, 141= :_col144, 142:_col145, 143:_col146, 144:_col147, 145:_col148, 146:_col149, = 147:_col150, 148:_col151, 149:_col152, 150:_col153, 151:_col154, 152:_col15= 5, 153:_col156, 154:_col157, 155:_col158, 156:_col159, 157:_col160, 158:_co= l161, 159:_col162, 160:_col163, 161:_col164, 162:_col165, 163:_col166, 164:= _col167, 165:_col168, 166:_col169, 167:_col170, 168:_col171, 169:_col318] > at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.get= StandardStructFieldRef(ObjectInspectorUtils.java:485) > at org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInsp= ector.getStructFieldRef(StandardStructObjectInspector.java:153) > at org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.initialize(Expr= NodeColumnEvaluator.java:80) > at org.apache.hadoop.hive.ql.exec.JoinUtil.getObjectInspectorsFromEvaluat= ors(JoinUtil.java:91) > at org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator.initializeOp(Ab= stractMapJoinOperator.java:74) > at org.apache.hadoop.hive.ql.exec.MapJoinOperator.initializeOp(MapJoinOpe= rator.java:144) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:374) > at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.init(ReduceRe= cordProcessor.java:195) > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProces= sor(TezProcessor.java:188) > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:= 172) > at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProc= essorRuntimeTask.java:370) > at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Calla= ble.java:73) > at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Calla= ble.java:61) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformat= ion.java:1869) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)