Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BF4A010675 for ; Sat, 5 Oct 2013 16:49:56 +0000 (UTC) Received: (qmail 71309 invoked by uid 500); 5 Oct 2013 16:49:46 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 71253 invoked by uid 500); 5 Oct 2013 16:49:45 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 71214 invoked by uid 500); 5 Oct 2013 16:49:44 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 71205 invoked by uid 99); 5 Oct 2013 16:49:43 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Oct 2013 16:49:43 +0000 Date: Sat, 5 Oct 2013 16:49:43 +0000 (UTC) From: "Hudson (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-5431) PassthroughOutputFormat SH changes causes IllegalArgumentException MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13787264#comment-13787264 ] Hudson commented on HIVE-5431: ------------------------------ FAILURE: Integrated in Hive-trunk-hadoop2 #482 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/482/]) HIVE-5431 : PassthroughOutputFormat SH changes causes IllegalArgumentException (Sushanth Sowmyan via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1529474) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java > PassthroughOutputFormat SH changes causes IllegalArgumentException > ------------------------------------------------------------------ > > Key: HIVE-5431 > URL: https://issues.apache.org/jira/browse/HIVE-5431 > Project: Hive > Issue Type: Bug > Affects Versions: 0.12.0 > Reporter: Sushanth Sowmyan > Assignee: Sushanth Sowmyan > Priority: Blocker > Fix For: 0.13.0 > > Attachments: HIVE-5431.2.patch, HIVE-5431.patch > > > The recent changes with HIVE-4331 introduced a new key "hive.passthrough.storagehandler.of", whose value is set only on storage handler writes, but obviously, will not be set on reads. However, PlanUtils.configureJobPropertiesForStorageHandler winds up trying to set the key for both cases into jobProperties, which cause any reads that are not preceeded by writes to fail. > Basically, if you have a .q in which you insert data into a hbase table and then read it, it's okay. If you have a .q in which you only read data, it throws an IllegalArgumentException, like so: > {noformat} > 2013-09-30 16:20:01,989 ERROR CliDriver (SessionState.java:printError(419)) - Failed with exception java.io.IOException:java.lang.IllegalArgumentException: Property value must not be null > java.io.IOException: java.lang.IllegalArgumentException: Property value must not be null > at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:551) > at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:489) > at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:136) > at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1471) > at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:271) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:348) > at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:446) > at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:456) > at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:737) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.lang.IllegalArgumentException: Property value must not be null > at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88) > at org.apache.hadoop.conf.Configuration.set(Configuration.java:810) > at org.apache.hadoop.conf.Configuration.set(Configuration.java:792) > at org.apache.hadoop.hive.ql.exec.Utilities.copyTableJobPropertiesToConf(Utilities.java:1826) > at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:380) > at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:515) > ... 17 more > {noformat} -- This message was sent by Atlassian JIRA (v6.1#6144)