hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2165) Augment JobHistory to store tasks' userlogs
Date Thu, 11 Sep 2008 05:16:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12630090#action_12630090

Arun C Murthy commented on HADOOP-2165:

This is mostly looking good, some comments:

1. I don't think it's worth the effort to do the HTTP HEAD, since the 2s timeout might be
too small if the http server is loaded etc. I'd rather put the link up and let the user click
on it and let the browser handle it.
2. In JobHistory.logStarted the conversion from List (to subList) and then array isn't necessary:
we should do something like:
Keys[] keys = null;
if (infoUrl == null) {
  keys = new Keys[] {a, b};
} else {
  keys = new Keys[] {a,b, c};

> Augment JobHistory to store tasks' userlogs
> -------------------------------------------
>                 Key: HADOOP-2165
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2165
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Arun C Murthy
>            Assignee: Vinod K V
>         Attachments: HADOOP-2165-20080910.1.txt, patch_userlog_1.4.3.txt
> It will be very useful to be able to see the job's userlogs (the stdout/stderr/syslog
of the tasks) from the JobHistory page. It will greatly aid in debugging etc.
> At the very minimum we should have links from the JobHistory to the logs on the TT.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message