From issues-return-178622-archive-asf-public=cust-asf.ponee.io@hive.apache.org Tue Feb 11 15:17:03 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id A84CE18063F for ; Tue, 11 Feb 2020 16:17:02 +0100 (CET) Received: (qmail 19760 invoked by uid 500); 11 Feb 2020 15:17:02 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 19750 invoked by uid 99); 11 Feb 2020 15:17:02 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Feb 2020 15:17:02 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 510F3E2EE5 for ; Tue, 11 Feb 2020 15:17:01 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 4D281780653 for ; Tue, 11 Feb 2020 15:17:00 +0000 (UTC) Date: Tue, 11 Feb 2020 15:17:00 +0000 (UTC) From: "Shivam (Jira)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-22771) Partition location incorrectly formed in FileOutputCommitterContainer MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-22771?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivam updated HIVE-22771: -------------------------- Attachment: HIVE-22771.4.patch > Partition location incorrectly formed in FileOutputCommitterContainer > --------------------------------------------------------------------- > > Key: HIVE-22771 > URL: https://issues.apache.org/jira/browse/HIVE-22771 > Project: Hive > Issue Type: Bug > Components: HCatalog > Affects Versions: 1.2.1 > Reporter: Shivam > Assignee: Shivam > Priority: Critical > Labels: pull-request-available > Attachments: HIVE-22771.2.patch, HIVE-22771.3.patch, HIVE-22771.4= .patch, HIVE-22771.patch > > Time Spent: 10m > Remaining Estimate: 0h > > Class _HCatOutputFormat_ in package=C2=A0_org.apache.hive.hcatalog.mapred= uce_ uses function=C2=A0_setOutput_ to generate _idHash_ using below statem= ent: > *+In file org/apache/hive/hcatalog/mapreduce/HCatOutputFormat.java+* > =C2=A0*line 116: idHash =3D String.valueOf(Math.random());* > The output of idHash can be similar to values like this : 7.1453471572391= 35E-4 > =C2=A0 > And, in class=C2=A0_FileOutputCommitterContainer_ in package=C2=A0_org.ap= ache.hive.hcatalog.mapreduce;_ > Uses below statement to compute final partition path: > +*In org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java= *+ > *line 366: String finalLocn =3D jobLocation.replaceAll(Path.SEPARATOR + S= CRATCH_DIR_NAME + "{color:#ff0000}\\d\\.? > d+"{color},"");* > *line 367: partPath =3D new Path(finalLocn);* > =C2=A0 > Regex used here is incorrect, since it will only remove integers after th= e=C2=A0*SCRATCH_DIR_NAME,*=C2=A0and hence will append=C2=A0 'E-4' (for the = above example) in the final partition location.=C2=A0 -- This message was sent by Atlassian Jira (v8.3.4#803005)