From issues-return-164904-archive-asf-public=cust-asf.ponee.io@hive.apache.org Mon Aug 12 04:33:03 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 4268D180674 for ; Mon, 12 Aug 2019 06:33:03 +0200 (CEST) Received: (qmail 1944 invoked by uid 500); 12 Aug 2019 04:33:02 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 1933 invoked by uid 99); 12 Aug 2019 04:33:02 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Aug 2019 04:33:02 +0000 Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id EF17AE2FAE for ; Mon, 12 Aug 2019 04:33:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 4A3002667C for ; Mon, 12 Aug 2019 04:33:00 +0000 (UTC) Date: Mon, 12 Aug 2019 04:33:00 +0000 (UTC) From: "mahesh kumar behera (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-22092) Fetch is failing with IllegalArgumentException: No ValidTxnList when refetch is done MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-22092?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh kumar behera updated HIVE-22092: --------------------------------------- Status: Patch Available (was: Open) > Fetch is failing with IllegalArgumentException: No ValidTxnList when refe= tch is done > -------------------------------------------------------------------------= ----------- > > Key: HIVE-22092 > URL: https://issues.apache.org/jira/browse/HIVE-22092 > Project: Hive > Issue Type: Bug > Reporter: mahesh kumar behera > Assignee: mahesh kumar behera > Priority: Major > Attachments: HIVE-22092.01.patch, HIVE-22092.02.patch, HIVE-22092= .03.patch > > > The fetch task is created during query compilation with the config of the= driver. That config will have the valid txn list set. Thus the fetch task = will have valid txn list set while doing fetch for ACID tables. But when us= er does a refetch with cusrsor set to first position it reinitializes the f= etch task with the driver config (cached in task config). But by that time,= the select query would have cleaned up the valid txn list from the config = and the fetch will happen with valid txn list as null. This will cause ille= gal=C2=A0argument=C2=A0exception. > =C2=A0 > Caused by: java.lang.IllegalArgumentException: No ValidTxnList fo > at org.apache.hadoop.hive.ql.io.AcidUtils.isDirUsable(AcidUtils.java:141= 8) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.io.AcidUtils.getChildState(AcidUtils.java:1= 393) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.io.AcidUtils.getAcidState(AcidUtils.java:12= 05) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.io.HiveInputFormat.processForWriteIds(HiveI= nputFormat.java:633) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.io.HiveInputFormat.processPathsForMmRead(Hi= veInputFormat.java:597) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar= :?] > at org.apache.hadoop.hive.ql.exec.FetchOperator.processCurrPathForMmWrit= eIds(FetchOperator.java:469) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-1= 2.jar:?] > at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOpera= tor.java:396) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOpe= rator.java:322) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator= .java:563) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.ja= va:532) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146) ~[= data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2362) ~[data_= analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver= .java:229) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLO= peration.java:473) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hive.service.cli.operation.OperationManager.getOperationNe= xtRowSet(OperationManager.java:328) ~[data_analytics_studio-webapp-1.3.1.1.= 3.1.0-12.jar:?] > at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(Hive= SessionImpl.java:952) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?= ] > at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:5= 65) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?] > at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(Thri= ftCLIService.java:792) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:= ?] > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults= .getResult(TCLIService.java:1837) ~[data_analytics_studio-webapp-1.3.1.1.3.= 1.0-12.jar:?] > at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults= .getResult(TCLIService.java:1822) ~[data_analytics_studio-webapp-1.3.1.1.3.= 1.0-12.jar:?] -- This message was sent by Atlassian JIRA (v7.6.14#76016)