hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1584) analysejobhistory.jsp doesn't analyse reduces of jobs with 0 maps
Date Wed, 10 Mar 2010 05:07:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12843437#action_12843437
] 

Amar Kamat commented on MAPREDUCE-1584:
---------------------------------------

Looking at the code, it looks like there are 3 states for the task : MAP, SHUFFLE and REDUCE.
Also for each of these states, following is printed : Best. Avg and Last. Can we factor out
the code? Something like
{code}
printTasks(out, TaskType, tasks[], comparator) {
newtasks[] = Arrays.sort(tasks, comparator);
out.print("<h1>Printing best performing " + TaskType.toString() + " task</h1>");
// print best
// print avg
// print worst
}
TaskType can be {MAP, SHUFFLE, REDUCE}
{code}

If yes, we can do something like 
{code}
if (maps.length > 0) {
  printTasks(MAP, maps, mapComp);
}
if (reduces.length > 0) {
  printTasks(SHUFFLE, reduces, shuffleComp);
  printTasks(REDUCE, reduces, redComp);
}
{code}

Ravi, can you please check if this can be done easily?

> analysejobhistory.jsp doesn't analyse reduces of jobs with 0 maps
> -----------------------------------------------------------------
>
>                 Key: MAPREDUCE-1584
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1584
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.22.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.22.0
>
>         Attachments: 1584.patch
>
>
> analysejobhistory.jsp returns without proceeding to 'analysing reduces' if the number
of maps in the job is 0.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message