hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil Govindan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-7097) MapReduce JHS should honor yarn.resourcemanager.display.per-user-apps
Date Fri, 25 May 2018 14:22:00 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-7097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490778#comment-16490778
] 

Sunil Govindan commented on MAPREDUCE-7097:
-------------------------------------------

Updating v4 patch.

Few thing to note here.

1. {{HsJobsBlock}} list all jos in JHS home page. But this is pulled from [CachedHistoryStorage|eclipse-javadoc:%E2%98%82=hadoop-mapreduce-client-hs/src%5C/main%5C/java%3Corg.apache.hadoop.mapreduce.v2.hs%7BCachedHistoryStorage.java%E2%98%83CachedHistoryStorage].getAllPartialJobs().
Hence we dont information about JobACLs. If we try to load full jobs to list, there will be
impact on performance when we load many jobs.

2. {{HsJobBlock}} could block entry for other users who are not owner/admin in cluster. To
load HsJobsBlock, we already load full job, hence acl check could be done easily.

Considering this, we will list all apps in JHS page, but each job cant be accessed for non-owner/non-admin. 

[~rohithsharma] [~vinodkv] kindly help to check latest patch.

Thank You

> MapReduce JHS should honor yarn.resourcemanager.display.per-user-apps
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-7097
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7097
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Sunil Govindan
>            Priority: Major
>         Attachments: MAPREDUCE-7097.001.patch, MAPREDUCE-7097.002.patch, MAPREDUCE-7097.003.patch,
MAPREDUCE-7097.004.patch
>
>
> When this config is on, MR JHS should filter the app list based on authenticated user.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message