hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3398) Log Aggregation broken in Secure Mode
Date Tue, 29 Nov 2011 00:27:40 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158971#comment-13158971
] 

Siddharth Seth commented on MAPREDUCE-3398:
-------------------------------------------

The NM adds apps to the keep-alive list when it gets a FINISH_APPLICATION from the resource
manager (Around line 452 of the patch - in {{NodeStatusUpdaterImpl}}). It uses the configured
token-renewal timeout set via configuration - the same value that is used by the RM. Token
renewal should only be happening if security and log-aggregation are enabled.
                
> Log Aggregation broken in Secure Mode
> -------------------------------------
>
>                 Key: MAPREDUCE-3398
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3398
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, nodemanager
>    Affects Versions: 0.23.0
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>            Priority: Critical
>             Fix For: 0.23.1
>
>         Attachments: MR3398_v1.txt
>
>
> Log aggregation in secure mode does not work with MAPREDUCE-2977. The nodemanager relies
on the users credentials to write out logs to HDFS. These credentials are currently cancelled
once a job completes, before the NM can write out the logs.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message