hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Tang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1229) [Mumak] Allow customization of job submission policy
Date Tue, 01 Dec 2009 20:15:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12784391#action_12784391
] 

Hong Tang commented on MAPREDUCE-1229:
--------------------------------------

Sample test output after the patch - as we can see, the jobs are submitted to the cluster
within the first 20ms.
{noformat}
Job job_200904211745_0002 is submitted at 1259697521583
1259697521583 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (20.0 <=
2.0*4635)
Job job_200904211745_0003 is submitted at 1259697521584
1259697521584 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (23.0 <=
2.0*4635)
Job job_200904211745_0004 is submitted at 1259697521585
1259697521585 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (154.0 <=
2.0*4635)
Job job_200904211745_0005 is submitted at 1259697521586
1259697521586 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (174.0 <=
2.0*4635)
Job job_200904211745_0006 is submitted at 1259697521587
1259697521587 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (209.0 <=
2.0*4635)
Job job_200904211745_0007 is submitted at 1259697521588
1259697521588 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (3413.0 <=
2.0*4635)
Job job_200904211745_0008 is submitted at 1259697521589
1259697521589 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (6617.0 <=
2.0*4635)
Job job_200904211745_0009 is submitted at 1259697521590
1259697521590 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (6718.0 <=
2.0*4635)
Job job_200904211745_0010 is submitted at 1259697521591
1259697521591 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (6719.0 <=
2.0*4635)
Job job_200904211745_0011 is submitted at 1259697521592
1259697521592 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (7219.0 <=
2.0*4635)
Job job_200904211745_0012 is submitted at 1259697521593
1259697521593 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (7220.0 <=
2.0*4635)
Job job_200904211745_0013 is submitted at 1259697521594
1259697521594 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (7240.0 <=
2.0*4635)
Job job_200904211745_0015 is submitted at 1259697521595
1259697521595 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (7241.0 <=
2.0*4635)
Job job_200904211745_0014 is submitted at 1259697521596
1259697521596 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (7242.0 <=
2.0*4635)
Job job_200904211745_0016 is submitted at 1259697521597
1259697521597 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (7742.0 <=
2.0*4635)
Job job_200904211745_0018 is submitted at 1259697521598
1259697521598 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (8242.0 <=
2.0*4635)
Job job_200904211745_0019 is submitted at 1259697521599
1259697521599 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (8243.0 <=
2.0*4635)
Job job_200904211745_0017 is submitted at 1259697521600
1259697521600 Overloaded is false: incompleteMapTasks <= 2.0*mapSlotCapacity (8244.0 <=
2.0*4635)
Job job_200904211745_0020 is submitted at 1259697521601
{noformat}

> [Mumak] Allow customization of job submission policy
> ----------------------------------------------------
>
>                 Key: MAPREDUCE-1229
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1229
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/mumak
>    Affects Versions: 0.21.0, 0.22.0
>            Reporter: Hong Tang
>            Assignee: Hong Tang
>             Fix For: 0.21.0, 0.22.0
>
>         Attachments: mapreduce-1229-20091121.patch, mapreduce-1229-20091123.patch, mapreduce-1229-20091130.patch,
mapreduce-1229-20091201.patch
>
>
> Currently, mumak replay job submission faithfully. To make mumak useful for evaluation
purposes, it would be great if we can support other job submission policies such as sequential
job submission, or stress job submission.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message