hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tassapol Athiapinya (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-2790) NM can't aggregate logs past HDFS delegation token expiry.
Date Fri, 31 Oct 2014 19:12:34 GMT
Tassapol Athiapinya created YARN-2790:

             Summary: NM can't aggregate logs past HDFS delegation token expiry.
                 Key: YARN-2790
                 URL: https://issues.apache.org/jira/browse/YARN-2790
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.6.0
            Reporter: Tassapol Athiapinya

We shorten hdfs delegation token lifetime, set RM to act as as a proxy user in order to be
able to renew the token on behalf of a user submitting the application. Still we see NM log
aggregation fail due to token expiry error.

2014-10-31 00:11:56,579 INFO  logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:finishLogAggregation(481))
- Application just finished : application_1414705229376_0004
2014-10-31 00:11:56,588 WARN  ipc.Client (Client.java:run(675)) - Exception encountered while
connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken):
token (HDFS_DELEGATION_TOKEN token 75 for hrt_qa) is expired
2014-10-31 00:11:56,589 ERROR logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:uploadLogsForContainers(233))
- Cannot create writer for app application_1414705229376_0004. Skip log upload this time.

This message was sent by Atlassian JIRA

View raw message