hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-10664) TestImportExport runs too long
Date Thu, 06 Mar 2014 01:19:43 GMT

    [ https://issues.apache.org/jira/browse/HBASE-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13921828#comment-13921828
] 

Andrew Purtell commented on HBASE-10664:
----------------------------------------

I did a naive split of the test cases into two units, and the total running time exceeded
by 100 seconds the time all cases require in a single unit. I could see by random sampling
of call stacks with jstack that the difference was YARN minicluster related teardown. During
test execution, if watching java processes with jps you might see the application master hanging
around with no executing child for a while. We might be able to tune the YARN minicluster
or MRAM to get some speedup.

> TestImportExport runs too long
> ------------------------------
>
>                 Key: HBASE-10664
>                 URL: https://issues.apache.org/jira/browse/HBASE-10664
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.98.0
>            Reporter: Andrew Purtell
>            Assignee: Rekha Joshi
>             Fix For: 0.98.1, 0.99.0
>
>
> Debugging with -Dsurefire.firstPartForkMode=always -Dsurefire.secondPartForkMode=always
looking for a hanging test. 
> 388 seconds.
> {noformat}
> Forking command line: /bin/sh -c cd /data/src/hbase/hbase-server && /usr/lib/jvm/java-1.7.0.45-oracle-amd64/jre/bin/java
-enableassertions -Xmx1900m -XX:MaxPermSize=100m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true
-Djava.awt.headless=true -jar /data/src/hbase/hbase-server/target/surefire/surefirebooter7637958208277391169.jar
/data/src/hbase/hbase-server/target/surefire/surefire6877889026110956843tmp /data/src/hbase/hbase-server/target/surefire/surefire_1907837210788480451831tmp
> Running org.apache.hadoop.hbase.mapreduce.TestImportExport
> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 388.246 sec
> {noformat}
> Slim down or break it up.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message