hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2120) TestGridmixSubmission consumes a lot of time.
Date Thu, 02 Jun 2011 10:15:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042678#comment-13042678
] 

Amar Kamat commented on MAPREDUCE-2120:
---------------------------------------

I reran Gridmix tests and here are the latest runtimes. 
{noformat}
[junit] Running org.apache.hadoop.mapred.gridmix.TestCompressionEmulationUtils
    [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 26.82 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestDistCacheEmulation
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 39.682 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestFilePool
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.134 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestFileQueue
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.051 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixRecord
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.451 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixSubmission
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 895.485 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestPseudoLocalFs
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.803 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestRandomAlgorithm
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.402 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestRandomTextDataGenerator
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.243 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestRecordFactory
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.501 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestSleepJob
    [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 718.842 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestUserResolve
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.072 sec
{noformat}

{{TestGridmixSubmission}} and {{TestSleepJob}} definitely needs rework.

For {{TestGridmixSubmission}}, here is the breakup
{noformat}
Testcase: testTraceReader took 0.445 sec
Testcase: testReplaySubmit took 437.801 sec
Testcase: testStressSubmit took 170.521 sec
Testcase: testStressSubmitWithDefaultQueue took 122.821 sec
Testcase: testSerialSubmit took 153.653 sec
{noformat}

For {{TestSleepJob}}, here is the breakup
{noformat}
Testcase: testReplaySubmit took 89.961 sec
Testcase: testRandomLocationSubmit took 87.975 sec
Testcase: testMapTasksOnlySubmit took 96.729 sec
Testcase: testLimitTaskSleepTimeSubmit took 98.474 sec
Testcase: testStressSubmit took 158.466 sec
Testcase: testSerialSubmit took 91.42 sec
Testcase: testRandomLocation took 0.085 sec
Testcase: testMapTasksOnlySleepJobs took 7.011 sec
{noformat}

> TestGridmixSubmission consumes a lot of time.
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2120
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2120
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/gridmix, test
>            Reporter: Amareshwari Sriramadasu
>
> TestGridmixSubmission consumes a lot of time. It took 582 seconds on my machine. The
test time should be improved.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message