hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mahesh kumar behera (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-22092) Fetch is failing with IllegalArgumentException: No ValidTxnList when refetch is done
Date Fri, 09 Aug 2019 05:36:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-22092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

mahesh kumar behera updated HIVE-22092:
---------------------------------------
    Attachment: HIVE-22092.01.patch

> Fetch is failing with IllegalArgumentException: No ValidTxnList when refetch is done
> ------------------------------------------------------------------------------------
>
>                 Key: HIVE-22092
>                 URL: https://issues.apache.org/jira/browse/HIVE-22092
>             Project: Hive
>          Issue Type: Bug
>            Reporter: mahesh kumar behera
>            Assignee: mahesh kumar behera
>            Priority: Major
>         Attachments: HIVE-22092.01.patch
>
>
> The fetch task is created during query compilation with the config of the driver. That
config will have the valid txn list set. Thus the fetch task will have valid txn list set
while doing fetch for ACID tables. But when user does a refetch with cusrsor set to first
position it reinitializes the fetch task with the driver config (cached in task config). But
by that time, the select query would have cleaned up the valid txn list from the config and
the fetch will happen with valid txn list as null. This will cause illegal argument exception.
>  
> Caused by: java.lang.IllegalArgumentException: No ValidTxnList fo
>  at org.apache.hadoop.hive.ql.io.AcidUtils.isDirUsable(AcidUtils.java:1418) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.io.AcidUtils.getChildState(AcidUtils.java:1393) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.io.AcidUtils.getAcidState(AcidUtils.java:1205) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.io.HiveInputFormat.processForWriteIds(HiveInputFormat.java:633)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.io.HiveInputFormat.processPathsForMmRead(HiveInputFormat.java:597)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.exec.FetchOperator.processCurrPathForMmWriteIds(FetchOperator.java:469)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:396)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:322)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:563) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:532) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2362) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver.java:229) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:473)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:328)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:952)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:565) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:792)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1837)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
>  at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1822)
~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Mime
View raw message