hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xianyin Xin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-5302) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II
Date Thu, 30 Jun 2016 12:52:10 GMT
Xianyin Xin created YARN-5302:
---------------------------------

             Summary: Yarn Application log Aggreagation fails due to NM can not get correct
HDFS delegation token II
                 Key: YARN-5302
                 URL: https://issues.apache.org/jira/browse/YARN-5302
             Project: Hadoop YARN
          Issue Type: Bug
          Components: yarn
            Reporter: Xianyin Xin


Different with YARN-5089, this happens at NM side. When NM recovers, credentials are read
from NMStateStore. When initialize app aggregators, exception happens because of the overdue
tokens.

{code:title=LogAggregationService.java}
  protected void initAppAggregator(final ApplicationId appId, String user,
      Credentials credentials, ContainerLogsRetentionPolicy logRetentionPolicy,
      Map<ApplicationAccessType, String> appAcls,
      LogAggregationContext logAggregationContext) {

    // Get user's FileSystem credentials
    final UserGroupInformation userUgi =
        UserGroupInformation.createRemoteUser(user);
    if (credentials != null) {
      userUgi.addCredentials(credentials);
    }

   ...

    try {
      // Create the app dir
      createAppDir(user, appId, userUgi);
    } catch (Exception e) {
      appLogAggregator.disableLogAggregation();
      if (!(e instanceof YarnRuntimeException)) {
        appDirException = new YarnRuntimeException(e);
      } else {
        appDirException = (YarnRuntimeException)e;
      }
      appLogAggregators.remove(appId);
      closeFileSystems(userUgi);
      throw appDirException;
    }
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message