bookkeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ivan Kelly <iv...@apache.org>
Subject Re: [VOTE] Bookkeeper 4.2.2 release candidate 0
Date Fri, 13 Sep 2013 09:49:31 GMT
The oom issue isn't a blocker (the problem is zk's oververbose
logging). BOOKKEEPER-683 is though.

I agree we should cancel this rc. However, it will probably be october
before I can cut a new one. Busy couple of weeks coming up.

-Ivan


On Thu, Sep 12, 2013 at 09:35:39PM +0100, Flavio Junqueira wrote:
> I'm getting the same problem with GcLedgersTest:
> 
> Exception in thread "ThreadedStreamConsumer" java.lang.OutOfMemoryError: Java heap space
> 	at java.util.Arrays.copyOf(Arrays.java:2367)
> 	at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
> 	at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
> 	at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:415)
> 	at java.lang.StringBuffer.append(StringBuffer.java:237)
> 	at org.apache.maven.surefire.report.ConsoleOutputFileReporter.writeMessage(ConsoleOutputFileReporter.java:115)
> 	at org.apache.maven.surefire.report.MulticastingReporter.writeMessage(MulticastingReporter.java:101)
> 	at org.apache.maven.surefire.report.TestSetRunListener.writeTestOutput(TestSetRunListener.java:99)
> 	at org.apache.maven.plugin.surefire.booterclient.output.ForkClient.consumeLine(ForkClient.java:132)
> 	at org.apache.maven.plugin.surefire.booterclient.output.ThreadedStreamConsumer$Pumper.run(ThreadedStreamConsumer.java:67)
> 	at java.lang.Thread.run(Thread.java:722)
> 
> and one test failure on hedwig-server (BOOKKEEPER-683). I don't want to be a party pooper,
but I'd feel more comfortable if we could fix these issues and have another release candidate.
What do you think?
> 
> -Flavio
> 
> 
> On Sep 12, 2013, at 3:27 PM, Jiannan Wang <jiannan@yahoo-inc.com> wrote:
> 
> > Agree, thanks for the finding.
> > 
> > Best,
> > Jiannan
> > 
> > On 9/12/13 6:05 PM, "Ivan Kelly" <ivank@apache.org> wrote:
> > 
> >> I managed to repro with
> >> MAVEN_OPTS="-Xmx128M" mvn test -Dtest=GcLedgersTest
> >> 
> >> The test in question creates 30000 ledgers, using asyncCreateLedgers,
> >> which causes a lot of zk INFO level log messages.
> >> 
> >> This isn't an issue worth blocking the release for.
> >> 
> >> -Ivan
> >> 
> >> On Thu, Sep 12, 2013 at 09:42:49AM +0000, Ivan Kelly wrote:
> >>> Hi Jiannan,
> >>> 
> >>> Could you send me the logs for this. The <argLine> in the pom has
no
> >>> affect here because that only applies to the surefire child
> >>> process. This OOM is in the maven process itself, because the test is
> >>> producing too many logs. I'll try reducing my heap to see if I can get
> >>> the same to happen.
> >>> 
> >>> -Ivan
> >>> 
> >>> 
> >>> On Thu, Sep 12, 2013 at 03:31:19AM +0000, Jiannan Wang wrote:
> >>>> +1 for this release.
> >>>> 
> >>>> All test cases pass except org.apache.bookkeeper.meta.GcLedgersTest,
> >>> which
> >>>> throws following exception
> >>>> ----------
> >>>> Exception in thread "ThreadedStreamConsumer"
> >>> java.lang.OutOfMemoryError:
> >>>> Java heap space
> >>>> 	at java.util.Arrays.copyOf(Arrays.java:2882)
> >>>> 	at 
> >>>> 
> >>> java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java
> >>> :1
> >>>> 00)
> >>>> 	at 
> >>> java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:390)
> >>>> 	at java.lang.StringBuffer.append(StringBuffer.java:224)
> >>>> 	at 
> >>>> 
> >>> org.apache.maven.surefire.report.ConsoleOutputFileReporter.writeMessage(C
> >>> on
> >>>> soleOutputFileReporter.java:115)
> >>>> 	at 
> >>>> 
> >>> org.apache.maven.surefire.report.MulticastingReporter.writeMessage(Multic
> >>> as
> >>>> tingReporter.java:101)
> >>>> 	at 
> >>>> 
> >>> org.apache.maven.surefire.report.TestSetRunListener.writeTestOutput(TestS
> >>> et
> >>>> RunListener.java:99)
> >>>> 	at 
> >>>> 
> >>> org.apache.maven.plugin.surefire.booterclient.output.ForkClient.consumeLi
> >>> ne
> >>>> (ForkClient.java:132)
> >>>> 	at 
> >>>> 
> >>> org.apache.maven.plugin.surefire.booterclient.output.ThreadedStreamConsum
> >>> er
> >>>> $Pumper.run(ThreadedStreamConsumer.java:67)
> >>>> 	at java.lang.Thread.run(Thread.java:680)
> >>>> ----------
> >>>> 
> >>>> I need to execute 'export MAVEN_OPTS="-Xmx1G"' before running the
> >>> test.
> >>>> (So the <argLine>-Xmx1G -Djava.net.preferIPv4Stack=true</argLine>
in
> >>>> pom.xml takes no effect? My maven version is Apache Maven 3.0.3
> >>> (r1075438;
> >>>> 2011-03-01 01:31:09+0800))
> >>>> 
> >>>> It's not a problem for the release, but I think maybe we can reduce
> >>>> annoying zk logs for this test to get around this problem.
> >>>> 
> >>>> 
> >>>> Best,
> >>>> Jiannan
> >>>> 
> >>>> 
> >>>> 
> >>>> 
> >>>> On 9/11/13 6:52 AM, "Ivan Kelly" <ivank@apache.org> wrote:
> >>>> 
> >>>>> This is the first release candidate for Apache Bookkeeper, version
> >>>>> 4.2.2.
> >>>>> 
> >>>>> This is a bugfix release for 4.2.1. There are some minor API
> >>>>> improvements. Notably, it is now possible to check whether a ledger
> >>> is
> >>>>> closed without opening it, and it is now possible to get a list
of
> >>>>> ledgers available in the cluster.
> >>>>> 
> >>>>> The full release notes is available at:
> >>>>> 
> >>>> 
> >>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12324601&
> >>>> st
> >>>>> yleName=Text&projectId=12311293
> >>>>> 
> >>>>> *** Please download, test and vote by September 16th 2013, 10:00
> >>> UTC+0.
> >>>>> ***
> >>>>> 
> >>>>> Note that we are voting upon the source (tag), binaries are provided
> >>> for
> >>>>> convenience.
> >>>>> 
> >>>>> Source and binary files:
> >>>>> http://people.apache.org/~ivank/bookkeeper-4.2.2-candidate-0/
> >>>>> 
> >>>>> Maven staging repo:
> >>>> 
> >>>> https://repository.apache.org/content/repositories/orgapachebookkeeper-0
> >>>> 25
> >>>>> /
> >>>>> 
> >>>>> The tag to be voted upon:
> >>>> 
> >>>> https://svn.apache.org/repos/asf/zookeeper/bookkeeper/tags/release-4.2.2
> >>>>> 
> >>>>> Bookkeeper's KEYS file containing PGP keys we use to sign the
> >>> release:
> >>>>> http://svn.apache.org/repos/asf/zookeeper/bookkeeper/dist/KEYS
> >>>>> 
> >>>>> Please download the the source package, and follow the README to
> >>> build
> >>>>> and run a bookkeeper and hedwig service.
> >>>>> 
> >>>>> -Ivan
> >>>> 
> > 
> 

Mime
View raw message