hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haibo Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6741) add MR support to redact job conf properties from JHS
Date Mon, 08 Aug 2016 18:16:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15412199#comment-15412199

Haibo Chen commented on MAPREDUCE-6741:

Patch uploaded to address Jason's comment. The changes are specifially,
1) values of redacted properties are replaced with a literal string "*********(redacted)"

2) properties are also redacted from AM UI
3) add the new configuration to mapred-default.xml
4) In JHSEventHandler, a new configuration is copied from the original. In AM UI, the configuration
object is loaded from the HDFS job.xml file every time the page is loaded, no need to make
a copy.

> add MR support to redact job conf properties from JHS
> -----------------------------------------------------
>                 Key: MAPREDUCE-6741
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6741
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 2.7.2
>            Reporter: Haibo Chen
>            Assignee: Haibo Chen
>         Attachments: mapreduce6741.001.patch, mapreduce6741.002.patch, mapreduce6741.003.patch,
> JHS today displays all Job conf properties in Web UI directly. Users may have some credentials
or any sensitive information they added to the job conf but do not want to be shown in Web
UI. It'd be nice if we can allow users to specify a set of properties which JHS will filter
out when Job conf is displayed.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org

View raw message