hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Tang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1229) [Mumak] Allow customization of job submission policy
Date Tue, 01 Dec 2009 19:57:21 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12784382#action_12784382

Hong Tang commented on MAPREDUCE-1229:

After sitting on it overnight, I think I can simplify isOverloaded() by eliminating the check
of occupied map slot percentage and use mainly pending map task count, which seems to be updated
by job tracker right after job submission. This would allow me to ramping up the load to the
cluster at a rapid rate of one job per mili-second without worrying about overshooting.

Will upload a patch shortly.

> [Mumak] Allow customization of job submission policy
> ----------------------------------------------------
>                 Key: MAPREDUCE-1229
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1229
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/mumak
>    Affects Versions: 0.21.0, 0.22.0
>            Reporter: Hong Tang
>            Assignee: Hong Tang
>             Fix For: 0.21.0, 0.22.0
>         Attachments: mapreduce-1229-20091121.patch, mapreduce-1229-20091123.patch, mapreduce-1229-20091130.patch
> Currently, mumak replay job submission faithfully. To make mumak useful for evaluation
purposes, it would be great if we can support other job submission policies such as sequential
job submission, or stress job submission.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message