Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4E6DB1781F for ; Thu, 29 Jan 2015 17:44:55 +0000 (UTC) Received: (qmail 46403 invoked by uid 500); 29 Jan 2015 17:44:54 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 46332 invoked by uid 500); 29 Jan 2015 17:44:53 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 46322 invoked by uid 99); 29 Jan 2015 17:44:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Jan 2015 17:44:53 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of muralikrishna.parimi@icloud.com designates 17.164.88.160 as permitted sender) Received: from [17.164.88.160] (HELO st13p17im-asmtp001.me.com) (17.164.88.160) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Jan 2015 17:44:26 +0000 Received: from st13p17im-spool001.me.com ([17.164.88.113]) by st13p17im-asmtp001.me.com (Oracle Communications Messaging Server 7.0.5.35.0 64bit (built Dec 4 2014)) with ESMTP id <0NIY009ET99Z1730@st13p17im-asmtp001.me.com> for user@hive.apache.org; Thu, 29 Jan 2015 17:44:24 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.13.68,1.0.33,0.0.0000 definitions=2015-01-29_06:2015-01-29,2015-01-29,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 suspectscore=1 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=7.0.1-1412080000 definitions=main-1501290171 MIME-version: 1.0 Content-type: multipart/alternative; boundary="Boundary_(ID_JjMQjX650Vc4eMxaQDRg4Q)" Received: from localhost ([17.164.88.115]) by st13p17im-spool001.mac.com (Oracle Communications Messaging Server 7.0.5.33.0 64bit (built Aug 27 2014)) with ESMTP id <0NIY00AIX99Z7H50@st13p17im-spool001.mac.com> for user@hive.apache.org; Thu, 29 Jan 2015 17:44:23 +0000 (GMT) To: user@hive.apache.org Cc: user@hive.apache.org From: murali parimi Subject: Re: Query fails for certain conditions in the while clause Date: Thu, 29 Jan 2015 17:44:22 +0000 (GMT) X-Mailer: iCloud MailClient15A99 MailServer15A.17977 X-Originating-IP: [66.175.245.2] Message-id: <0923a7b0-c51c-43b7-9359-d6aacb0ae7ca@me.com> X-Virus-Checked: Checked by ClamAV on apache.org --Boundary_(ID_JjMQjX650Vc4eMxaQDRg4Q) Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: quoted-printable please ignore. Wrong thread!=0A=0A=0A=0AOn Jan 29, 2015, at 09:33 PM, Most= afa T wrote:=0A=0Awould you elaborate please=0A=0AOn= Thu, Jan 29, 2015 at 5:50 PM, murali parimi wrote:=0AMy bad. The tables are Bucketed on the same join key.=0A=0AS= ent from my iPhone=0A=0AOn Jan 29, 2015, at 9:38 AM, Mostafa T wrote:=0A=0AHello,=0AI try to run a nested query.=0AIn the wher= e clause in the inner query if I include all of the expressions hereunder,= it fails.=0AWHERE query_id =3D 6028=0AAND created_at_basic_date >=3D 2014= 1230=0AAND created_at_basic_date <=3D =A020150126=0A=0AHowever if I includ= ed only the query_id or one or both of the dates, it works.=0A=0AIt's a we= ird case for me, your help will be appreciated.=0A=0Ahere's the full query= :=0A=0ASELECT *=0AFROM=0A(=0ASELECT INLINE(ngrams(sentences(lower(text)), = 1, 100))=0AFROM tweets ft INNER JOIN tweet_query tq ON (ft.tweet_id =3D tq= .tweet_id)=0AWHERE query_id =3D 6028=0AAND created_at >=3D 20141230=0AAND = created_at <=3D =A020150126=0A) AS f=0ALEFT OUTER JOIN stop_words sw ON(f.= ngram[0] =3D sw.word)=0AWHERE sw.word IS NULL=0A=0A=0AHere's the partial l= og:=0A=0A2015-01-29 17:17:32,858 ERROR SessionState (SessionState.java:pri= ntError(833)) - Status: Failed=0A2015-01-29 17:17:32,895 ERROR SessionStat= e (SessionState.java:printError(833)) - Vertex failed, vertexName=3DReduce= r 2, vertexId=3Dvertex_1422267635031_0652_1_03, diagnostics=3D[Task failed= , taskId=3Dtask_1422267635031_0652_1_03_000000, diagnostics=3D[TaskAttempt= 0 failed, info=3D[Error: Failure while running task:java.lang.RuntimeExce= ption: java.lang.RuntimeException: Hive Runtime Error while closing operat= ors: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPoint= erException=0Aat org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializ= eAndRunProcessor(TezProcessor.java:186)=0Aat org.apache.hadoop.hive.ql.exe= c.tez.TezProcessor.run(TezProcessor.java:138)=0Aat org.apache.tez.runtime.= LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)=0A= at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezT= askRunner.java:176)=0Aat org.apache.tez.runtime.task.TezTaskRunner$TaskRun= nerCallable$1.run(TezTaskRunner.java:168)=0Aat java.security.AccessControl= ler.doPrivileged(Native Method)=0Aat javax.security.auth.Subject.doAs(Subj= ect.java:415)=0Aat org.apache.hadoop.security.UserGroupInformation.doAs(Us= erGroupInformation.java:1628)=0Aat org.apache.tez.runtime.task.TezTaskRunn= er$TaskRunnerCallable.call(TezTaskRunner.java:168)=0Aat org.apache.tez.run= time.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)=0A= at java.util.concurrent.FutureTask.run(FutureTask.java:262)=0Aat java.util= .concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)=0Aa= t java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja= va:615)=0Aat java.lang.Thread.run(Thread.java:745)=0ACaused by: java.lang.= RuntimeException: Hive Runtime Error while closing operators: org.apache.h= adoop.hive.ql.metadata.HiveException: java.lang.NullPointerException=0Aat = org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecor= dProcessor.java:214)=0Aat org.apache.hadoop.hive.ql.exec.tez.TezProcessor.= initializeAndRunProcessor(TezProcessor.java:177)=0A... 13 more=0ACaused by= : org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive= .ql.metadata.HiveException: java.lang.NullPointerException=0Aat org.apache= .hadoop.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1149)=0A= at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)=0Aat o= rg.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecord= Processor.java:196)=0A... 14 more=0ACaused by: org.apache.hadoop.hive.ql.m= etadata.HiveException: java.lang.NullPointerException=0Aat org.apache.hado= op.hive.ql.exec.GroupByOperator.flush(GroupByOperator.java:1107)=0Aat org.= apache.hadoop.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:11= 46)=0A... 16 more=0ACaused by: java.lang.NullPointerException=0Aat java.ut= il.ArrayList.(ArrayList.java:164)=0Aat org.apache.hadoop.hive.ql.udf= .generic.GenericUDTFInline.process(GenericUDTFInline.java:60)=0Aat org.apa= che.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperator.java:108)=0Aat= org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)=0Aat o= rg.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java= :84)=0Aat org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:81= 5)=0Aat org.apache.hadoop.hive.ql.exec.GroupByOperator.forward(GroupByOper= ator.java:1072)=0Aat org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(= GroupByOperator.java:1097)=0A... 17 more=0A], TaskAttempt 1 failed, info=3D= [Error: Failure while running task:java.lang.RuntimeException: java.lang.R= untimeException: Hive Runtime Error while closing operators: org.apache.ha= doop.hive.ql.metadata.HiveException: java.lang.NullPointerException=0Aat o= rg.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(T= ezProcessor.java:186)=0Aat org.apache.hadoop.hive.ql.exec.tez.TezProcessor= .run(TezProcessor.java:138)=0Aat org.apache.tez.runtime.LogicalIOProcessor= RuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324)=0Aat org.apache.te= z.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:1= 76)=0Aat org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.ru= n(TezTaskRunner.java:168)=0Aat java.security.AccessController.doPrivileged= (Native Method)=0Aat javax.security.auth.Subject.doAs(Subject.java:415)=0A= at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformati= on.java:1628)=0Aat org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCal= lable.call(TezTaskRunner.java:168)=0Aat org.apache.tez.runtime.task.TezTas= kRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)=0Aat java.util.con= current.FutureTask.run(FutureTask.java:262)=0Aat java.util.concurrent.Thre= adPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)=0Aat java.util.conc= urrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)=0Aat jav= a.lang.Thread.run(Thread.java:745)=0ACaused by: java.lang.RuntimeException= : Hive Runtime Error while closing operators: org.apache.hadoop.hive.ql.me= tadata.HiveException: java.lang.NullPointerException=0Aat org.apache.hadoo= p.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:= 214)=0Aat org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRun= Processor(TezProcessor.java:177)=0A... 13 more=0ACaused by: org.apache.had= oop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.Hiv= eException: java.lang.NullPointerException=0Aat org.apache.hadoop.hive.ql.= exec.GroupByOperator.closeOp(GroupByOperator.java:1149)=0Aat org.apache.ha= doop.hive.ql.exec.Operator.close(Operator.java:598)=0Aat org.apache.hadoop= .hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:1= 96)=0A... 14 more=0ACaused by: org.apache.hadoop.hive.ql.metadata.HiveExce= ption: java.lang.NullPointerException=0Aat org.apache.hadoop.hive.ql.exec.= GroupByOperator.flush(GroupByOperator.java:1107)=0Aat org.apache.hadoop.hi= ve.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1146)=0A... 16 mor= e=0ACaused by: java.lang.NullPointerException=0Aat java.util.ArrayList.(ArrayList.java:164)=0Aat org.apache.hadoop.hive.ql.udf.generic.Generic= UDTFInline.process(GenericUDTFInline.java:60)=0Aat org.apache.hadoop.hive.= ql.exec.UDTFOperator.processOp(UDTFOperator.java:108)=0Aat org.apache.hado= op.hive.ql.exec.Operator.forward(Operator.java:815)=0Aat org.apache.hadoop= .hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)=0Aat org.ap= ache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815)=0Aat org.apac= he.hadoop.hive.ql.exec.GroupByOperator.forward(GroupByOperator.java:1072)=0A= at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator.ja= va:1097)=0A... 17 more=0A], TaskAttempt 2 failed, info=3D[Error: Failure w= hile running task:java.lang.RuntimeException: java.lang.RuntimeException: = Hive Runtime Error while closing operators: org.apache.hadoop.hive.ql.meta= data.HiveException: java.lang.NullPointerException=0Aat org.apache.hadoop.= hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:= 186)=0Aat org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor= .java:138)=0Aat org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(L= ogicalIOProcessorRuntimeTask.java:324)=0Aat org.apache.tez.runtime.task.Te= zTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:176)=0Aat org.apac= he.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.j= ava:168)=0Aat java.security.AccessController.doPrivileged(Native Method)=0A= at javax.security.auth.Subject.doAs(Subject.java:415)=0Aat org.apache.hado= op.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)=0Aat= org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTask= Runner.java:168)=0Aat org.apache.tez.runtime.task.TezTaskRunner$TaskRunner= Callable.call(TezTaskRunner.java:163)=0Aat java.util.concurrent.FutureTask= .run(FutureTask.java:262)=0Aat java.util.concurrent.ThreadPoolExecutor.run= Worker(ThreadPoolExecutor.java:1145)=0Aat java.util.concurrent.ThreadPoolE= xecutor$Worker.run(ThreadPoolExecutor.java:615)=0Aat java.lang.Thread.run(= Thread.java:745)=0ACaused by: java.lang.RuntimeException: Hive Runtime Err= or while closing operators: org.apache.hadoop.hive.ql.metadata.HiveExcepti= on: java.lang.NullPointerException=0Aat org.apache.hadoop.hive.ql.exec.tez= .ReduceRecordProcessor.close(ReduceRecordProcessor.java:214)=0Aat org.apac= he.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProce= ssor.java:177)=0A... 13 more=0ACaused by: org.apache.hadoop.hive.ql.metada= ta.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.l= ang.NullPointerException=0Aat org.apache.hadoop.hive.ql.exec.GroupByOperat= or.closeOp(GroupByOperator.java:1149)=0Aat org.apache.hadoop.hive.ql.exec.= Operator.close(Operator.java:598)=0Aat org.apache.hadoop.hive.ql.exec.tez.= ReduceRecordProcessor.close(ReduceRecordProcessor.java:196)=0A... 14 more=0A= Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.Nul= lPointerException=0Aat org.apache.hadoop.hive.ql.exec.GroupByOperator.flus= h(GroupByOperator.java:1107)=0Aat org.apache.hadoop.hive.ql.exec.GroupByOp= erator.closeOp(GroupByOperator.java:1146)=0A... 16 more=0ACaused by: java.= lang.NullPointerException=0Aat java.util.ArrayList.(ArrayList.java:1= 64)=0Aat org.apache.hadoop.hive.ql.udf.generic.GenericUDTFInline.process(G= enericUDTFInline.java:60)=0Aat org.apache.hadoop.hive.ql.exec.UDTFOperator= .processOp(UDTFOperator.java:108)=0Aat org.apache.hadoop.hive.ql.exec.Oper= ator.forward(Operator.java:815)=0Aat org.apache.hadoop.hive.ql.exec.Select= Operator.processOp(SelectOperator.java:84)=0Aat org.apache.hadoop.hive.ql.= exec.Operator.forward(Operator.java:815)=0Aat org.apache.hadoop.hive.ql.ex= ec.GroupByOperator.forward(GroupByOperator.java:1072)=0Aat org.apache.hado= op.hive.ql.exec.GroupByOperator.flush(GroupByOperator.java:1097)=0A... 17 = more=0A], TaskAttempt 3 failed, info=3D[Error: Failure while running task:= java.lang.RuntimeException: java.lang.RuntimeException: Hive Runtime Error= while closing operators: org.apache.hadoop.hive.ql.metadata.HiveException= : java.lang.NullPointerException=0Aat org.apache.hadoop.hive.ql.exec.tez.T= ezProcessor.initializeAndRunProcessor(TezProcessor.java:186)=0Aat org.apac= he.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:138)=0Aat or= g.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorR= untimeTask.java:324)=0Aat org.apache.tez.runtime.task.TezTaskRunner$TaskRu= nnerCallable$1.run(TezTaskRunner.java:176)=0Aat org.apache.tez.runtime.tas= k.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)=0Aat java= .security.AccessController.doPrivileged(Native Method)=0Aat javax.security= .auth.Subject.doAs(Subject.java:415)=0Aat org.apache.hadoop.security.UserG= roupInformation.doAs(UserGroupInformation.java:1628)=0Aat org.apache.tez.r= untime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)=0A= at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTa= skRunner.java:163)=0Aat java.util.concurrent.FutureTask.run(FutureTask.jav= a:262)=0Aat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1145)=0Aat java.util.concurrent.ThreadPoolExecutor$Worker.run(= ThreadPoolExecutor.java:615)=0Aat java.lang.Thread.run(Thread.java:745)=0A= Caused by: java.lang.RuntimeException: Hive Runtime Error while closing op= erators: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullP= ointerException=0Aat org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProces= sor.close(ReduceRecordProcessor.java:214)=0Aat org.apache.hadoop.hive.ql.e= xec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:177)=0A..= . 13 more=0ACaused by: org.apache.hadoop.hive.ql.metadata.HiveException: o= rg.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerExce= ption=0Aat org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp(GroupByO= perator.java:1149)=0Aat org.apache.hadoop.hive.ql.exec.Operator.close(Oper= ator.java:598)=0Aat org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcess= or.close(ReduceRecordProcessor.java:196)=0A... 14 more=0ACaused by: org.ap= ache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException= =0Aat org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator= .java:1107)=0Aat org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp(Gr= oupByOperator.java:1146)=0A... 16 more=0ACaused by: java.lang.NullPointerE= xception=0Aat java.util.ArrayList.(ArrayList.java:164)=0Aat org.apac= he.hadoop.hive.ql.udf.generic.GenericUDTFInline.process(GenericUDTFInline.= java:60)=0Aat org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOp= erator.java:108)=0Aat org.apache.hadoop.hive.ql.exec.Operator.forward(Oper= ator.java:815)=0Aat org.apache.hadoop.hive.ql.exec.SelectOperator.processO= p(SelectOperator.java:84)=0Aat org.apache.hadoop.hive.ql.exec.Operator.for= ward(Operator.java:815)=0Aat org.apache.hadoop.hive.ql.exec.GroupByOperato= r.forward(GroupByOperator.java:1072)=0Aat org.apache.hadoop.hive.ql.exec.G= roupByOperator.flush(GroupByOperator.java:1097)=0A... 17 more=0A]], Vertex= failed as one or more tasks failed. failedTasks:1, Vertex vertex_14222676= 35031_0652_1_03 [Reducer 2] killed/failed due to:null]=0A2015-01-29 17:17:= 32,895 ERROR SessionState (SessionState.java:printError(833)) - DAG failed= due to vertex failure. failedVertices:1 killedVertices:0=0A2015-01-29 17:= 17:32,896 INFO =A0log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - =0A2015-= 01-29 17:17:32,970 INFO =A0counters.Limits (Limits.java:ensureInitialized(= 59)) - Counter limits initialized with parameters: =A0GROUP_NAME_MAX=3D128= , MAX_GROUPS=3D500, COUNTER_NAME_MAX=3D64, MAX_COUNTERS=3D1200=0A2015-01-2= 9 17:17:32,980 INFO =A0hooks.ATSHook (ATSHook.java:(87)) - Created A= TS Hook=0A2015-01-29 17:17:32,980 INFO =A0log.PerfLogger (PerfLogger.java:= PerfLogBegin(108)) - =0A2015-01-29 17:= 17:32,981 INFO =A0log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - =0A2015-01-29 17:17:32,981 INFO =A0hooks.ATSHook (ATSHook.jav= a:createPostHookEvent(170)) - Received post-hook notification for :hadoop_= 20150129171010_b09291bf-724d-42b7-986a-2527d829bc72=0A2015-01-29 17:17:32,= 982 ERROR ql.Driver (SessionState.java:printError(833)) - FAILED: Executio= n Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask=0A=0A= =0A--=A0=0ABest Regards,=0AMostafa=0A=0A= --Boundary_(ID_JjMQjX650Vc4eMxaQDRg4Q) Content-type: multipart/related; boundary="Boundary_(ID_Ta0Y3W42ySC89PIv/ZqTqQ)"; type="text/html" --Boundary_(ID_Ta0Y3W42ySC89PIv/ZqTqQ) Content-type: text/html; CHARSET=US-ASCII Content-transfer-encoding: quoted-printable
please ignore. Wrong thread!


=
On Jan 29, 2015, at 09:33 PM, Mostafa T <mtpulse90@gmail.com> wr= ote:

=
would you elaborate please

On Thu, Jan 29, 2015 at 5:50 PM, mura= li parimi <muralikr= ishna.parimi@icloud.com> wrote:
My bad. The tables are Bucketed on the same = join key.

Sent from my iPhone

= On Jan 29, 2015, at 9:38 AM, Mostafa T <mtpulse90@gmail.com> wrote:


at java.security.AccessController.doPrivileged(Native Method)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Hive Runtime Error while c= losing operators: org.apache.hadoop.hive.ql.metadata.HiveException: java.l= ang.NullPointerException
at org.apache.hadoop.hive.ql.exec.tez.R= educeRecordProcessor.close(ReduceRecordProcessor.java:214)
at or= g.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(Te= zProcessor.java:177)
... 13 more
Caused by: org.apache= .hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata= .HiveException: java.lang.NullPointerException
at org.apache.had= oop.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1149)
<= div>at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(= ReduceRecordProcessor.java:196)
... 14 more
Caused by:= org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerEx= ception
at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(= GroupByOperator.java:1107)
at org.apache.hadoop.hive.ql.exec.Gro= upByOperator.closeOp(GroupByOperator.java:1146)
... 16 more
Caused by: java.lang.NullPointerException
at java.util.Arr= ayList.<init>(ArrayList.java:164)
at org.apache.hadoop.hiv= e.ql.udf.generic.GenericUDTFInline.process(GenericUDTFInline.java:60)
at org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperato= r.java:108)
at org.apache.hadoop.hive.ql.exec.Operator.forward(O= perator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperat= or.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.q= l.exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.= hive.ql.exec.GroupByOperator.forward(GroupByOperator.java:1072)
= at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator.ja= va:1097)
... 17 more
], TaskAttempt 1 failed, info=3D[= Error: Failure while running task:java.lang.RuntimeException: java.lang.Ru= ntimeException: Hive Runtime Error while closing operators: org.apache.had= oop.hive.ql.metadata.HiveException: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProc= essor(TezProcessor.java:186)
at org.apache.hadoop.hive.ql.exec.t= ez.TezProcessor.run(TezProcessor.java:138)
at org.apache.tez.run= time.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:= 324)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCall= able$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.tas= k.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
at java.security.AccessController.doPrivileged(Native Method)
a= t javax.security.auth.Subject.doAs(Subject.java:415)
at org.apac= he.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:162= 8)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallab= le.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.T= ezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at = java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java= .util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145= )
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo= olExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Hive Runtime Error while cl= osing operators: org.apache.hadoop.hive.ql.metadata.HiveException: java.la= ng.NullPointerException
at org.apache.hadoop.hive.ql.exec.tez.Re= duceRecordProcessor.close(ReduceRecordProcessor.java:214)
at org= .apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(Tez= Processor.java:177)
... 13 more
Caused by: org.apache.= hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.= HiveException: java.lang.NullPointerException
at org.apache.hado= op.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1149)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(R= educeRecordProcessor.java:196)
... 14 more
Caused by: = org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerExc= eption
at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(G= roupByOperator.java:1107)
at org.apache.hadoop.hive.ql.exec.Grou= pByOperator.closeOp(GroupByOperator.java:1146)
... 16 more
=
Caused by: java.lang.NullPointerException
at java.util.Arra= yList.<init>(ArrayList.java:164)
at org.apache.hadoop.hive= .ql.udf.generic.GenericUDTFInline.process(GenericUDTFInline.java:60)
=
at org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperator= .java:108)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Op= erator.java:815)
at org.apache.hadoop.hive.ql.exec.SelectOperato= r.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql= .exec.Operator.forward(Operator.java:815)
at org.apache.hadoop.h= ive.ql.exec.GroupByOperator.forward(GroupByOperator.java:1072)
a= t org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator.jav= a:1097)
... 17 more
], TaskAttempt 2 failed, info=3D[E= rror: Failure while running task:java.lang.RuntimeException: java.lang.Run= timeException: Hive Runtime Error while closing operators: org.apache.hado= op.hive.ql.metadata.HiveException: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProce= ssor(TezProcessor.java:186)
at org.apache.hadoop.hive.ql.exec.te= z.TezProcessor.run(TezProcessor.java:138)
at org.apache.tez.runt= ime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:3= 24)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCalla= ble$1.run(TezTaskRunner.java:176)
at org.apache.tez.runtime.task= .TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:168)
= at java.security.AccessController.doPrivileged(Native Method)
at= javax.security.auth.Subject.doAs(Subject.java:415)
at org.apach= e.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628= )
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallabl= e.call(TezTaskRunner.java:168)
at org.apache.tez.runtime.task.Te= zTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:163)
at j= ava.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.= util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)=
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo= lExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Hive Runtime Error while clo= sing operators: org.apache.hadoop.hive.ql.metadata.HiveException: java.lan= g.NullPointerException
at org.apache.hadoop.hive.ql.exec.tez.Red= uceRecordProcessor.close(ReduceRecordProcessor.java:214)
at org.= apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezP= rocessor.java:177)
... 13 more
Caused by: org.apache.h= adoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.H= iveException: java.lang.NullPointerException
at org.apache.hadoo= p.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1149)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(Re= duceRecordProcessor.java:196)
... 14 more
Caused by: o= rg.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerExce= ption
at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(Gr= oupByOperator.java:1107)
at org.apache.hadoop.hive.ql.exec.Group= ByOperator.closeOp(GroupByOperator.java:1146)
... 16 more
<= div>Caused by: java.lang.NullPointerException
at java.util.Array= List.<init>(ArrayList.java:164)
at org.apache.hadoop.hive.= ql.udf.generic.GenericUDTFInline.process(GenericUDTFInline.java:60)
<= div>at org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperator.= java:108)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProces= sor(TezProcessor.java:186)
at java.u= til.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)<= /div>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPool= Executor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Hive Runtime Error while clos= ing operators: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang= .NullPointerException
at org.apache.hadoop.hive.ql.exec.tez.Redu= ceRecordProcessor.close(ReduceRecordProcessor.java:214)
at org.a= pache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezPr= ocessor.java:177)
... 13 more
Caused by: org.apache.ha= doop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.Hi= veException: java.lang.NullPointerException
at org.apache.hadoop= .hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1149)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
=
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(Red= uceRecordProcessor.java:196)
... 14 more
Caused by: or= g.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerExcep= tion
at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(Gro= upByOperator.java:1107)
at org.apache.hadoop.hive.ql.exec.GroupB= yOperator.closeOp(GroupByOperator.java:1146)
... 16 more
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperator.j= ava:108)
2015-01-29 17:17:32,970 INFO  counters.Limits (Limits.java:ensureIn= itialized(59)) - Counter limits initialized with parameters:  GROUP_N= AME_MAX=3D128, MAX_GROUPS=3D500, COUNTER_NAME_MAX=3D64, MAX_COUNTERS=3D120= 0


-- 
Best Regards,
Mostafa
=

= --Boundary_(ID_Ta0Y3W42ySC89PIv/ZqTqQ)-- --Boundary_(ID_JjMQjX650Vc4eMxaQDRg4Q)--