hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-679) XML-based metrics as JSP servlet for JobTracker
Date Wed, 09 Sep 2009 23:47:57 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Aaron Kimball updated MAPREDUCE-679:

    Attachment: MAPREDUCE-679.5.patch

As you note, this API exposes nothing that's not already part of jobtracker.jsp. I don't see
this as a fundamentally new API, just a new presentation layer for existing data. The same
exact hooks are used in both.

I'm attaching a new patch with a thread-safe call to getRunningJobs() instead of runningJobs().
I changed jobtracker.jsp to do the same; also added getCompletedJobs() and getFailedJobs()
that use the same synchronzation discipline as getRunningJobs(). Finally, I added a "retired
jobs" section that conforms to the API of MAPREDUCE-870.

Tested all of this locally by running jobs and checking the output XML for validation.

> XML-based metrics as JSP servlet for JobTracker
> -----------------------------------------------
>                 Key: MAPREDUCE-679
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-679
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: example-jobtracker-completed-job.xml, example-jobtracker-running-job.xml,
MAPREDUCE-679.2.patch, MAPREDUCE-679.3.patch, MAPREDUCE-679.4.patch, MAPREDUCE-679.5.patch,
> In HADOOP-4559, a general REST API for reporting metrics was proposed but work seems
to have stalled. In the interim, we have a simple XML translation of the existing JobTracker
status page which provides the same metrics (including the tables of running/completed/failed
jobs) as the human-readable page. This is a relatively lightweight addition to provide some
machine-understandable metrics reporting.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message