Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9FBF117CAB for ; Sun, 28 Sep 2014 04:56:33 +0000 (UTC) Received: (qmail 48823 invoked by uid 500); 28 Sep 2014 04:56:23 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 48671 invoked by uid 500); 28 Sep 2014 04:56:23 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 48659 invoked by uid 99); 28 Sep 2014 04:56:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 28 Sep 2014 04:56:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of adityaexalter@gmail.com designates 209.85.218.53 as permitted sender) Received: from [209.85.218.53] (HELO mail-oi0-f53.google.com) (209.85.218.53) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 28 Sep 2014 04:56:17 +0000 Received: by mail-oi0-f53.google.com with SMTP id a3so957163oib.26 for ; Sat, 27 Sep 2014 21:55:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Bwe7zGQSfolO9c7CDEbYCX/uay4EqwBiPxSZtMFRpR0=; b=Mk4oWanUjlCSyZu0UaLLkbOlE+A5rzTLYOoKe7YwOnPDplHMmitfwUY0M9arj79BYv M0ub1hbVe9UvjrqJBkFPGLD3LwDNCXiNPxQIRUYwm+OyXupP6u56Z+XRFBm/n3fT6iwl OhZcY/Kav6vrODmGXnqSJ6sUxtqN84V5kLPo7fgX2Ccxyl9n0nnuk3SfShop1JorU2mD Pbo1zuf0IB+aPSiu55vH7drShk6bXxVCsMIR6rSjdIZkKOCWCJdq0694lbhNBFAxIs/b IOTVBrdZUI7YWrhM0AMStPta+JyVu2sLbvpSifilH75gkmQvuvCJwvubC2BvtNQ433n8 ZMcQ== MIME-Version: 1.0 X-Received: by 10.182.18.101 with SMTP id v5mr31876848obd.64.1411880156449; Sat, 27 Sep 2014 21:55:56 -0700 (PDT) Received: by 10.182.37.68 with HTTP; Sat, 27 Sep 2014 21:55:56 -0700 (PDT) In-Reply-To: References: Date: Sun, 28 Sep 2014 10:25:56 +0530 Message-ID: Subject: Re: Hive query not working From: Aditya exalter To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c3306030d197050418f717 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c3306030d197050418f717 Content-Type: text/plain; charset=UTF-8 Hi , I got the issue and solved it , As my metastore was configure with PostgreSQL we are unable to query with partition.But after we changed it to MySQL i a m able to query with partition. Thanks, Aditya K. On Fri, Sep 26, 2014 at 12:15 AM, Aditya exalter wrote: > HI all, > > I have a hive table partitioned with date (d) as string but while > running the query i am getting following exception. > > SELECT * FROM click WHERE d>="2014-09-25" ; > > > FAILED: SemanticException MetaException(message:javax.jdo.JDOException: > Invocation of method "substring" on "StringExpression" requires argument 1 > of type "NumericExpression" > at > org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:600) > at org.datanucleus.api.jdo.JDOQuery.executeWithMap(JDOQuery.java:351) > at > org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsViaOrmFilter(ObjectStore.java:1983) > at > org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExprInternal(ObjectStore.java:1859) > at > org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExpr(ObjectStore.java:1797) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108) > at com.sun.proxy.$Proxy0.getPartitionsByExpr(Unknown Source) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:3328) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:105) > at com.sun.proxy.$Proxy5.get_partitions_by_expr(Unknown Source) > at > org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiveMetastore.java:7340) > at > org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiveMetastore.java:7324) > at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) > at > org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110) > at > org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:107) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554) > at > org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:556) > at > org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118) > at > org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:244) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > NestedThrowablesStackTrace: > Invocation of method "substring" on "StringExpression" requires argument 1 > of type "NumericExpression" > org.datanucleus.exceptions.NucleusException: Invocation of method > "substring" on "StringExpression" requires argument 1 of type > "NumericExpression" > at > org.datanucleus.store.rdbms.sql.method.StringSubstringMethod.getExpression(StringSubstringMethod.java:85) > at > org.datanucleus.store.rdbms.sql.expression.SQLExpressionFactory.invokeMethod(SQLExpressionFactory.java:328) > at > org.datanucleus.store.rdbms.sql.expression.StringExpression.invoke(StringExpression.java:494) > at > org.datanucleus.store.rdbms.query.QueryToSQLMapper.processInvokeExpression(QueryToSQLMapper.java:2900) > at > org.datanucleus.query.evaluator.AbstractExpressionEvaluator.compilePrimaryExpression(AbstractExpressionEvaluator.java:200) > at > org.datanucleus.query.evaluator.AbstractExpressionEvaluator.compileUnaryExpression(AbstractExpressionEvaluator.java:169) > at > org.datanucleus.query.evaluator.AbstractExpressionEvaluator.compileAdditiveMultiplicativeExpression(AbstractExpressionEvaluator.java:148) > > > thanks and regards, > Aditya k. > --001a11c3306030d197050418f717 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi ,

=C2=A0I got the issue and solved i= t ,
=C2=A0
=C2=A0As my metastore was configure with Pos= tgreSQL we are unable to query with partition.But after we changed it to My= SQL i a m able to query with partition.


=
Thanks,
Aditya K.

=
On Fri, Sep 26, 2014 at 12:15 AM, Aditya exalter= <adityaexalter@gmail.com> wrote:
HI all,

=C2=A0= I have a hive table partitioned with date (d) as string but while running = the query i am getting following exception.

SELECT * FR= OM click WHERE d>=3D"2014-09-25" ;


=
FAILED: SemanticException MetaException(message:javax.jdo.J= DOException: Invocation of method "substring" on "StringExpr= ession" requires argument 1 of type "NumericExpression"
at org.datanucleus.api.j= do.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.jav= a:600)
at org.datanu= cleus.api.jdo.JDOQuery.executeWithMap(JDOQuery.java:351)
at org.apache.hadoop.hive.metastore.Ob= jectStore.getPartitionsViaOrmFilter(ObjectStore.java:1983)
at org.apache.hadoop.hive.metastore.= ObjectStore.getPartitionsByExprInternal(ObjectStore.java:1859)
at org.apache.hadoop.hive.metast= ore.ObjectStore.getPartitionsByExpr(ObjectStore.java:1797)
at sun.reflect.NativeMethodAccessorI= mpl.invoke0(Native Method)
= at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorI= mpl.java:57)
at sun.= reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja= va:43)
at java.lang.= reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke= (RawStoreProxy.java:108)
at com.sun.proxy.$Proxy0.getPartitionsByExpr(Unknown Source)
at org.apache.hadoop.hive.met= astore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:3= 328)
at sun.reflect.= NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(= NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegating= MethodAccessorImpl.java:43)
= at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.hive.metastore= .RetryingHMSHandler.invoke(RetryingHMSHandler.java:105)
at com.sun.proxy.$Proxy5.get_partitions= _by_expr(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$= get_partitions_by_expr.getResult(ThriftHiveMetastore.java:7340)
<= span style=3D"white-space:pre-wrap"> at org.apache.hadoop.hive.metas= tore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(Thr= iftHiveMetastore.java:7324)
= at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:3= 9)
at org.apache.had= oop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)
at org.apache.hadoop.h= ive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:107)
at java.security.AccessCont= roller.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
<= div> at org.apache.hadoop.secur= ity.UserGroupInformation.doAs(UserGroupInformation.java:1554)
at org.apache.hadoop.hive.shims.H= adoopShimsSecure.doAs(HadoopShimsSecure.java:556)
at org.apache.hadoop.hive.metastore.TUGIBased= Processor.process(TUGIBasedProcessor.java:118)
at org.apache.thrift.server.TThreadPoolServer$Wo= rkerProcess.run(TThreadPoolServer.java:244)
at java.util.concurrent.ThreadPoolExecutor.runWorke= r(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo= lExecutor.java:615)
= at java.lang.Thread.run(Thread.java:745)
NestedThrowablesStackTra= ce:
Invocation of method "substring" on "StringExp= ression" requires argument 1 of type "NumericExpression"
org.datanucleus.exceptions.NucleusException: Invocation of method &q= uot;substring" on "StringExpression" requires argument 1 of = type "NumericExpression"
at org.datanucleus.store.rdbms.sql.method.StringSubstringMet= hod.getExpression(StringSubstringMethod.java:85)
at org.datanucleus.store.rdbms.sql.expression.= SQLExpressionFactory.invokeMethod(SQLExpressionFactory.java:328)
= at org.datanucleus.store.rdbms= .sql.expression.StringExpression.invoke(StringExpression.java:494)
at org.datanucleus.store.rdb= ms.query.QueryToSQLMapper.processInvokeExpression(QueryToSQLMapper.java:290= 0)
at org.datanucleu= s.query.evaluator.AbstractExpressionEvaluator.compilePrimaryExpression(Abst= ractExpressionEvaluator.java:200)
at org.datanucleus.query.evaluator.AbstractExpressionEvaluato= r.compileUnaryExpression(AbstractExpressionEvaluator.java:169)
at org.datanucleus.query.evaluat= or.AbstractExpressionEvaluator.compileAdditiveMultiplicativeExpression(Abst= ractExpressionEvaluator.java:148)


=
thanks and regards,
Aditya k.

--001a11c3306030d197050418f717--