Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 691DB101F4 for ; Wed, 10 Dec 2014 22:59:15 +0000 (UTC) Received: (qmail 64797 invoked by uid 500); 10 Dec 2014 22:59:15 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 64660 invoked by uid 500); 10 Dec 2014 22:59:14 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 64484 invoked by uid 500); 10 Dec 2014 22:59:14 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 64481 invoked by uid 99); 10 Dec 2014 22:59:14 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Dec 2014 22:59:14 +0000 Date: Wed, 10 Dec 2014 22:59:14 +0000 (UTC) From: "Jason Dere (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-9073) NPE when using custom windowing UDAFs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-9073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-9073: ----------------------------- Component/s: UDF > NPE when using custom windowing UDAFs > ------------------------------------- > > Key: HIVE-9073 > URL: https://issues.apache.org/jira/browse/HIVE-9073 > Project: Hive > Issue Type: Bug > Components: UDF > Reporter: Jason Dere > Assignee: Jason Dere > > From the hive-user email group: > {noformat} > While executing a simple select query using a custom windowing UDAF I created I am constantly running into this error. > > Error: java.lang.RuntimeException: Error in configuring object > at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109) > at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75) > at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133) > at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:409) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106) > ... 9 more > Caused by: java.lang.RuntimeException: Reduce operator initialization failed > at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.configure(ExecReducer.java:173) > ... 14 more > Caused by: java.lang.NullPointerException > at org.apache.hadoop.hive.ql.exec.FunctionRegistry.getFunctionInfo(FunctionRegistry.java:647) > at org.apache.hadoop.hive.ql.exec.FunctionRegistry.getWindowFunctionInfo(FunctionRegistry.java:1875) > at org.apache.hadoop.hive.ql.udf.ptf.WindowingTableFunction.streamingPossible(WindowingTableFunction.java:150) > at org.apache.hadoop.hive.ql.udf.ptf.WindowingTableFunction.setCanAcceptInputAsStream(WindowingTableFunction.java:221) > at org.apache.hadoop.hive.ql.udf.ptf.WindowingTableFunction.initializeStreaming(WindowingTableFunction.java:266) > at org.apache.hadoop.hive.ql.exec.PTFOperator$PTFInvocation.initializeStreaming(PTFOperator.java:292) > at org.apache.hadoop.hive.ql.exec.PTFOperator.initializeOp(PTFOperator.java:86) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:460) > at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:416) > at org.apache.hadoop.hive.ql.exec.ExtractOperator.initializeOp(ExtractOperator.java:40) > at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376) > at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.configure(ExecReducer.java:166) > ... 14 more > > Just wanted to check if any of you have faced this earlier. Also when I try to run the Custom UDAF on another server it works fine. The only difference I can see it that the hive version I am using on my local machine is 0.13.1 where it is working and on the other machine it is 0.13.0 where I see the above mentioned error. I am not sure if this was a bug which was fixed in the later release but I just wanted to confirm the same. > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)