From issues-return-199615-archive-asf-public=cust-asf.ponee.io@hive.apache.org Tue Sep 29 13:30:03 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 27AEA18068A for ; Tue, 29 Sep 2020 15:30:03 +0200 (CEST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id 634AF43A12 for ; Tue, 29 Sep 2020 13:30:02 +0000 (UTC) Received: (qmail 5622 invoked by uid 500); 29 Sep 2020 13:30:02 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 5601 invoked by uid 99); 29 Sep 2020 13:30:02 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Sep 2020 13:30:02 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 309A74288C for ; Tue, 29 Sep 2020 13:30:00 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 44FDF780403 for ; Tue, 29 Sep 2020 13:30:00 +0000 (UTC) Date: Tue, 29 Sep 2020 13:30:00 +0000 (UTC) From: "Ashish Sharma (Jira)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work started] (HIVE-24124) NPE occurs when bucket_version different bucket tables are joined MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-24124?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-24124 started by Ashish Sharma. -------------------------------------------- > NPE occurs when bucket_version different bucket tables are joined > ----------------------------------------------------------------- > > Key: HIVE-24124 > URL: https://issues.apache.org/jira/browse/HIVE-24124 > Project: Hive > Issue Type: Bug > Components: Hive > Reporter: GuangMing Lu > Assignee: Ashish Sharma > Priority: Major > > {code:java} > create table z_tab_1( > =C2=A0=C2=A0=C2=A0 task_id=C2=A0 string,=C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 data_date=C2=A0 string,=C2=A0=20 > =C2=A0=C2=A0=C2=A0 accno=C2=A0 string,=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 curr_type=C2=A0 string,=C2=A0=20 > =C2=A0=C2=A0=C2=A0 ifrs9_pd12_value=C2=A0 double, > =C2=A0=C2=A0=C2=A0 ifrs9_ccf_value=C2=A0 double, > =C2=A0=C2=A0=C2=A0 ifrs9_lgd_value=C2=A0 double > )partitioned by(pt_dt string) > STORED AS ORCFILE > TBLPROPERTIES ('bucketing_version'=3D'1'); > alter table z_tab_1 add partition(pt_dt =3D '2020-7-31'); > insert into z_tab_1 partition(pt_dt =3D '2020-7-31') values > ('123','2020-7-31','accno-xxxx','curr_type-xxxxx', 0.1, 0.2 ,0.3), > ('1','2020-1-31','a','1-curr_type-a', 0.1, 0.2 ,0.3), > ('2','2020-2-31','b','2-curr_type-b', 0.1, 0.2 ,0.3), > ('3','2020-3-31','c','3-curr_type-c', 0.1, 0.2 ,0.3), > ('4','2020-4-31','d','4-curr_type-d', 0.1, 0.2 ,0.3), > ('5','2020-5-31','e','5-curr_type-e', 0.1, 0.2 ,0.3), > ('6','2020-6-31','f','6-curr_type-f', 0.1, 0.2 ,0.3), > ('7','2020-7-31','g','7-curr_type-g', 0.1, 0.2 ,0.3), > ('8','2020-8-31','h','8-curr_type-h', 0.1, 0.2 ,0.3), > ('9','2020-9-31','i','9-curr_type-i', 0.1, 0.2 ,0.3); > drop table if exists z_tab_2; > CREATE TABLE z_tab_2(=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 task_id=C2=A0 string,=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 data_date=C2=A0 string,=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 accno=C2=A0 string,=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 curr_type=C2=A0 string,=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 ifrs9_pd12_value=C2=A0 double,=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 ifrs9_ccf_value=C2=A0 double,=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=20 > =C2=A0=C2=A0=C2=A0 ifrs9_lgd_value=C2=A0 double > )=20 > CLUSTERED BY (TASK_ID, DATA_DATE, ACCNO, CURR_TYPE)=C2=A0 SORTED by (TASK= _ID, ACCNO, CURR_TYPE) INTO 2000 BUCKETS=20 > ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' > STORED AS ORCFILE; > set hive.enforce.bucketing=3Dtrue; > INSERT OVERWRITE TABLE z_tab_2 > SELECT=C2=A0 DCCR.TASK_ID > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ,DCCR.DATA_DATE > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ,DCCR.ACCNO > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ,DCCR.CURR_TYPE > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ,DCCR.IFRS9_PD12_VALUE > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ,DCCR.IFRS9_CCF_VALUE > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ,DCCR.IFRS9_LGD_VALUE=20 > FROM z_tab_1 DCCR > WHERE pt_dt =3D '2020-7-31'; > {code} > {noformat} > Caused by: java.lang.NullPointerException =C2=A0 > at org.apache.hadoop.hive.ql.exec.FileSinkOperator.findWriterOffset(FileS= inkOperator.java:1072) =C2=A0 > at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperat= or.java:988) =C2=A0 > at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:995)= =C2=A0 > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:941) =C2= =A0 > at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:928) =C2= =A0 > at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.j= ava:95) =C2=A0 > at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:= 237) =C2=A0 > ... 7 more{noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005)