hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hari Sekhon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3670) Add JobConf XML link in Yarn RM UI
Date Mon, 18 May 2015 13:59:59 GMT

    [ https://issues.apache.org/jira/browse/YARN-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14548039#comment-14548039
] 

Hari Sekhon commented on YARN-3670:
-----------------------------------

I understand (you can't imagine how often I've had to refrain from asking for Maps and Reduces
to be available in UI like trusty old MRv1). At the moment it's too opaque, which is a first
generation side-effect of Yarn being a generally abstracting resource manager.

However, perhaps it would be possible to create a generic mechanism that allows jobs to publish
key-value pairs which could be populated with either settings or counters to be displayed
via a new named link also specified per set of key-value pairs, such as a job could publish
"counters" or "configuration". In this way both the MapReduce client, the Tez client and any
other YARN apps would have the ability to publish any arbitrary key-value pair table of information
to YARN to display in the UI?

This would help immensely with debugging yarn jobs.

> Add JobConf XML link in Yarn RM UI
> ----------------------------------
>
>                 Key: YARN-3670
>                 URL: https://issues.apache.org/jira/browse/YARN-3670
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: webapp
>    Affects Versions: 2.6.0
>         Environment: HDP 2.2
>            Reporter: Hari Sekhon
>            Priority: Minor
>
> Request to add JobConf xml link for each application in the RM UI so I don't have to
keep recovering it from HDFS to debug if job settings are taking effect.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message