hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-679) XML-based metrics as JSP servlet for JobTracker
Date Wed, 26 Aug 2009 11:59:59 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12747902#action_12747902
] 

Steve Loughran commented on MAPREDUCE-679:
------------------------------------------

I actually quite like XML interfaces you can GET as a way of seeing what's going on
* people can read them
* you can directly import them into any spreadsheet that can GET+Xpath a document, including
google spreadsheets (if you were to expose your cluster to the world)
* code can get then XSLT them into useful forms
* if the error code is meaningful, you can have routers keep an eye on them. For that to work,
you need the ability to set limits in the report (eg. have a query param that specifies the
minimum #of nodes you want for the cluster to be considered functional)

And, unlike every other JSP page in the codebase, it has a test. This will reduce maintenance
costs, as future patches are less likely to break things.

> XML-based metrics as JSP servlet for JobTracker
> -----------------------------------------------
>
>                 Key: MAPREDUCE-679
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-679
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: example-jobtracker-completed-job.xml, example-jobtracker-running-job.xml,
MAPREDUCE-679.2.patch, MAPREDUCE-679.3.patch, MAPREDUCE-679.patch
>
>
> In HADOOP-4559, a general REST API for reporting metrics was proposed but work seems
to have stalled. In the interim, we have a simple XML translation of the existing JobTracker
status page which provides the same metrics (including the tables of running/completed/failed
jobs) as the human-readable page. This is a relatively lightweight addition to provide some
machine-understandable metrics reporting.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message