hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2638) Create a simple stress test for the fair scheduler
Date Mon, 18 Jul 2011 20:53:57 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067291#comment-13067291
] 

Tom White commented on MAPREDUCE-2638:
--------------------------------------

Thanks Matei. The preemption intervals are indeed very low - they are set like this in order
to trigger preemption in a pseudo-distributed cluster and so stress the scheduler. For larger
clusters the settings you suggest are entirely appropriate, as well as increasing the sleep
time in the jobs by setting {{test.fairscheduler.sleepTime}} to a higher value.

> Create a simple stress test for the fair scheduler
> --------------------------------------------------
>
>                 Key: MAPREDUCE-2638
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2638
>             Project: Hadoop Map/Reduce
>          Issue Type: Test
>          Components: contrib/fair-share
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: MAPREDUCE-2638.patch, MAPREDUCE-2638.patch
>
>
> This would be a test that runs against a cluster, typically with settings that allow
preemption to be exercised.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message