hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Debarshi Basak <>
Subject Re:
Date Wed, 23 May 2012 09:12:48 GMT
<font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><DIV>But
what i am doing is i am creating index then setting the path of the index and running a select&nbsp;&lt;columns&gt;
from table_name where &lt;condition&gt;</DIV>
<DIV>How can i resolve this issue?<BR><BR><BR>Debarshi Basak<BR>Tata
Consultancy Services<BR>Mailto:<BR>Website:<BR>____________________________________________<BR>Experience
certainty. IT Services<BR>Business Solutions<BR>Outsourcing<BR>____________________________________________<BR><BR><FONT
color=#990099>-----alo alt <WGET.NULL@GOOGLEMAIL.COM>wrote: -----</FONT> </DIV>
black 2px solid; MARGIN-RIGHT: 0px">To:<BR>From: alo alt &lt;;<BR>Date:
05/23/2012 02:08PM<BR>Subject: Re:<BR><BR><PRE>Hi,

<A href=""></A>

This message means that for some reason the garbage collector is taking an excessive amount
of time (by default 98% of all CPU time of the process) and recovers very little memory in
each run (by default 2% of the heap).

Alexander Alten-Lorenz
<A href=""></A>
German Hadoop LinkedIn Group: <A href=""></A>

On May 23, 2012, at 10:13 AM, Debarshi Basak wrote:

&gt; When i am trying to run a query with index i am getting this exception.My hive version
is 0.7.1
&gt; java.lang.OutOfMemoryError: GC overhead limit exceeded
&gt;         at java.nio.ByteBuffer.wrap(
&gt;         at
&gt;         at
&gt;         at org.apache.hadoop.hive.ql.index.compact.HiveCompactIndexResult.add(
&gt;         at org.apache.hadoop.hive.ql.index.compact.HiveCompactIndexResult.&lt;init&gt;(
&gt;         at org.apache.hadoop.hive.ql.index.compact.HiveCompactIndexInputFormat.getSplits(
&gt;         at org.apache.hadoop.mapred.JobClient.writeOldSplits(
&gt;         at org.apache.hadoop.mapred.JobClient.writeSplits(
&gt;         at org.apache.hadoop.mapred.JobClient.access$500(
&gt;         at org.apache.hadoop.mapred.JobClient$
&gt;         at org.apache.hadoop.mapred.JobClient$
&gt;         at Method)
&gt;         at
&gt;         at
&gt;         at org.apache.hadoop.mapred.JobClient.submitJobInternal(
&gt;         at org.apache.hadoop.mapred.JobClient.submitJob(
&gt;         at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(
&gt;         at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(
&gt;         at org.apache.hadoop.hive.ql.exec.Task.executeTask(
&gt;         at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(
&gt;         at org.apache.hadoop.hive.ql.Driver.launchTask(
&gt;         at org.apache.hadoop.hive.ql.Driver.execute(
&gt;         at
&gt;         at org.apache.hadoop.hive.cli.CliDriver.processCmd(
&gt;         at org.apache.hadoop.hive.cli.CliDriver.processLine(
&gt;         at org.apache.hadoop.hive.cli.CliDriver.main(
&gt;         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
&gt;         at sun.reflect.NativeMethodAccessorImpl.invoke(
&gt;         at sun.reflect.DelegatingMethodAccessorImpl.invoke(
&gt;         at java.lang.reflect.Method.invoke(
&gt;         at org.apache.hadoop.util.RunJar.main(
&gt; Debarshi Basak
&gt; Tata Consultancy Services
&gt; Mailto:
&gt; Website: <A href=""></A>
&gt; ____________________________________________
&gt; Experience certainty. IT Services
&gt; Business Solutions
&gt; Outsourcing
&gt; ____________________________________________
&gt; =====-----=====-----=====
&gt; Notice: The information contained in this e-mail
&gt; message and/or attachments to it may contain 
&gt; confidential or privileged information. If you are 
&gt; not the intended recipient, any dissemination, use, 
&gt; review, distribution, printing or copying of the 
&gt; information contained in this e-mail message 
&gt; and/or attachments to it are strictly prohibited. If 
&gt; you have received this communication in error, 
&gt; please notify us by reply e-mail or telephone and 
&gt; immediately and permanently delete the message 
&gt; and any attachments. Thank you

View raw message