cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Semb Wever (Jira)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-15979) CircleCI UnitTests error - java.lang.OutOfMemoryError: Java heap space
Date Fri, 31 Jul 2020 14:46:00 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-15979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168902#comment-17168902
] 

Michael Semb Wever edited comment on CASSANDRA-15979 at 7/31/20, 2:45 PM:
--------------------------------------------------------------------------

bq. Has anyone seen this outside of CircleCI?  I've never encountered it locally and I don't
recall seeing it in Jenkins either.

[~brandon.williams], yes I've seen this and had to work around it in Jenkins, when aggregating
all the build stage test xml reports into one file and then transforming it. The aggregated
xml containing ~18k tests is 1.5GB+ and there's no way any of those agents can Xalan xslt
transform them. (Saxon was needed.)

To solve the problem there, I had to do the aggregation manually with ant, and then the xslt
transformation with saxon outside of a JVM. 
- https://github.com/apache/cassandra-builds/blob/master/build-scripts/cassandra-test-report.sh
- https://github.com/apache/cassandra-builds/blob/master/docker/jenkins/generate_plaintext_test_report.docker#L23

This is also why the Test results in the Jenkins branch pipelines are built upon all the individual
test xml files, instead of this aggregated massive xml file.
 - https://github.com/apache/cassandra/blob/trunk/.jenkins/Jenkinsfile#L347


was (Author: michaelsembwever):
bq. Has anyone seen this outside of CircleCI?  I've never encountered it locally and I don't
recall seeing it in Jenkins either.

[~brandon.williams], yes I've seen this and had to work around it in Jenkins, when aggregating
all the build stage test xml reports into one file and then transforming it. The aggregated
xml containing ~18k tests is 1.5GB+ and there's no way any of those agents can Xalan xslt
transform them. (Saxon was needed.)

To solve the problem there, I had to do the aggregation manually with ant, and then the xslt
transformation with saxon outside of a JVM. 
- https://github.com/apache/cassandra-builds/blob/master/build-scripts/cassandra-test-report.sh
- https://github.com/apache/cassandra-builds/blob/master/docker/jenkins/generate_plaintext_test_report.docker#L23

> CircleCI UnitTests error - java.lang.OutOfMemoryError: Java heap space
> ----------------------------------------------------------------------
>
>                 Key: CASSANDRA-15979
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-15979
>             Project: Cassandra
>          Issue Type: Bug
>          Components: CI
>            Reporter: Ekaterina Dimitrova
>            Assignee: Ekaterina Dimitrova
>            Priority: Normal
>
> We persistently see on the latest CircleCI trunk the following error:
> (MIDRES)
>  
> {code:java}
> BUILD FAILED
> /tmp/cassandra/build.xml:1982: The following error occurred while executing this line:
> /tmp/cassandra/build.xml:1866: java.lang.OutOfMemoryError: Java heap space
>  at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:68)
>  at java.lang.StringBuffer.<init>(StringBuffer.java:128)
>  at com.sun.org.apache.xml.internal.utils.FastStringBuffer.getString(FastStringBuffer.java:872)
>  at com.sun.org.apache.xml.internal.dtm.ref.sax2dtm.SAX2DTM2.getStringValueX(SAX2DTM2.java:2937)
>  at com.sun.org.apache.xalan.internal.xsltc.dom.DOMAdapter.getStringValueX(DOMAdapter.java:284)
>  at junit_frames.template$dot$5()
>  at junit_frames.applyTemplates5()
>  at junit_frames.package()
>  at junit_frames.template$dot$0()
>  at junit_frames.applyTemplates()
>  at junit_frames.applyTemplates()
>  at junit_frames.transform()
>  at com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.transform(AbstractTranslet.java:620)
>  at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:730)
>  at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:343)
>  at org.apache.tools.ant.taskdefs.optional.TraXLiaison.transform(TraXLiaison.java:201)
>  at org.apache.tools.ant.taskdefs.XSLTProcess.process(XSLTProcess.java:870)
>  at org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:408)
>  at org.apache.tools.ant.taskdefs.optional.junit.AggregateTransformer.transform(AggregateTransformer.java:281)
>  at org.apache.tools.ant.taskdefs.optional.junit.XMLResultAggregator.execute(XMLResultAggregator.java:157)
>  at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
>  at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
>  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:99)
>  at org.apache.tools.ant.Task.perform(Task.java:350)
>  at org.apache.tools.ant.taskdefs.Sequential$$Lambda$149/1543351283.accept(Unknown Source)
>  at java.util.Vector.forEach(Vector.java:1275)
>  at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:67)
>  at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
>  at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
>  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Total time: 2 minutes 52 seconds
> Exited with code exit status 1
> CircleCI received exit code 1
> {code}
>  
> *Example:* [https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/285/workflows/f2722016-2353-4c38-9fd2-8614f6609f55/jobs/1648/parallel-runs/16?filterBy=FAILED]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org


Mime
View raw message