hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: More heap space for unit tests
Date Wed, 23 Nov 2011 17:07:55 GMT
https://issues.apache.org/jira/browse/HBASE-4856 has been created.

Shall we upgrade hadoop version for hadoop-0.20 to 0.20.205.1-7070-SNAPSHOT
as well ?

On Wed, Nov 23, 2011 at 9:00 AM, Stack <stack@duboce.net> wrote:

> On Wed, Nov 23, 2011 at 8:53 AM, Ted Yu <yuzhihong@gmail.com> wrote:
> > The heap space error happened again for build #9
> >
> > TestMasterFailover hung in build 9 too.
> >
>
> Yes.  You mean the pom setting?  Want to make an issue Ted w/ patch?
> (Maybe more crap going on when security in the mix pushing is over
> edge; we should dig in on Todd suggestion but I'd say till then up the
> build heap).
>
> St.Ack
>
> > On Tue, Nov 22, 2011 at 2:07 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> >
> >> The interesting thing is that their counterparts in HBase-0.92 build
> >> didn't run out of heap :-)
> >>
> >>
> >> On Tue, Nov 22, 2011 at 2:05 PM, Todd Lipcon <todd@cloudera.com> wrote:
> >>
> >>> Usually IME this means that some test is generating many GB of logs,
> >>> etc... before raising heap let's look and see if some of the tests are
> >>> being excessively noisy
> >>>
> >>> -Todd
> >>>
> >>> On Tue, Nov 22, 2011 at 2:01 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> >>> > Hi,
> >>> > I found the following in
> >>> >
> >>>
> https://builds.apache.org/view/G-L/view/HBase/job/HBase-0.92-security/lastCompletedBuild/console
> >>> > :
> >>> >
> >>> > Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting
> >>> > Exception in thread "ThreadedStreamConsumer"
> >>> > java.lang.OutOfMemoryError: Java heap space
> >>> >        at java.util.Arrays.copyOf(Arrays.java:2882)
> >>> >        at
> >>>
> java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
> >>> >        at
> >>> java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:390)
> >>> >        at java.lang.StringBuffer.append(StringBuffer.java:224)
> >>> >        at
> >>>
> org.apache.maven.surefire.report.TestSetRunListener.getAsString(TestSetRunListener.java:201)
> >>> >        at
> >>>
> org.apache.maven.surefire.report.TestSetRunListener.testError(TestSetRunListener.java:139)
> >>> >        at
> >>>
> org.apache.maven.plugin.surefire.booterclient.output.ForkClient.consumeLine(ForkClient.java:112)
> >>> > Running org.apache.hadoop.hbase.master.TestMasterFailover
> >>> > Exception in thread "ThreadedStreamConsumer"
> >>> > java.lang.OutOfMemoryError: Java heap space
> >>> >        at java.util.Arrays.copyOf(Arrays.java:2882)
> >>> >        at
> >>>
> java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
> >>> >        at
> >>> java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:390)
> >>> >        at java.lang.StringBuffer.append(StringBuffer.java:224)
> >>> >        at
> >>>
> org.apache.maven.surefire.report.TestSetRunListener.getAsString(TestSetRunListener.java:201)
> >>> >        at
> >>>
> org.apache.maven.surefire.report.TestSetRunListener.testError(TestSetRunListener.java:139)
> >>> >
> >>> > Currently each unit test is given 1.9GB of heap.
> >>> > I think we should give more heap to the tests.
> >>> >
> >>> > Cheers
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> Todd Lipcon
> >>> Software Engineer, Cloudera
> >>>
> >>
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message