Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1F50110CEA for ; Fri, 27 Dec 2013 21:26:52 +0000 (UTC) Received: (qmail 29480 invoked by uid 500); 27 Dec 2013 21:26:51 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 29424 invoked by uid 500); 27 Dec 2013 21:26:51 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 29414 invoked by uid 500); 27 Dec 2013 21:26:51 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 29411 invoked by uid 99); 27 Dec 2013 21:26:51 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Dec 2013 21:26:51 +0000 Date: Fri, 27 Dec 2013 21:26:51 +0000 (UTC) From: "Nick Dimiduk (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-6117) mapreduce.RecordReader instance needs to be initialized MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13857747#comment-13857747 ] Nick Dimiduk commented on HIVE-6117: ------------------------------------ Not sure; can I force the SELECT statement to run as a job? > mapreduce.RecordReader instance needs to be initialized > ------------------------------------------------------- > > Key: HIVE-6117 > URL: https://issues.apache.org/jira/browse/HIVE-6117 > Project: Hive > Issue Type: Bug > Components: HBase Handler > Reporter: Nick Dimiduk > Assignee: Nick Dimiduk > Attachments: 6117.00.patch > > > The HBase storage handler makes use of a mapreduce.RecordReader instance but does not initialize it when consumed from local context. This results in a NPE for some queries, for instance > {noformat} > create table hbase_1(key string, age int) stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' with serdeproperties ( "hbase.columns.mapping" = "info:age"); > insert overwrite table hbase_1 select name, SUM(age) from studenttab10k group by name; > select * from hbase_1; > {noformat} > The select statement throws the following exception > {noformat} > 13/12/18 01:30:32 ERROR CliDriver: Failed with exception java.io.IOException:java.lang.NullPointerException > java.io.IOException: java.lang.NullPointerException > at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:551) > at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:489) > at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:136) > at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1494) > at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:271) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:348) > at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:446) > at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:456) > at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:737) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:601) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.lang.NullPointerException > at org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:196) > at org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:138) > at org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat$1.next(HiveHBaseTableInputFormat.java:234) > at org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat$1.next(HiveHBaseTableInputFormat.java:193) > at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:521) > {noformat} -- This message was sent by Atlassian JIRA (v6.1.5#6160)