Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-issues@hadoop.apache.org
Date: Wed, 26 Jun 2013 15:40:20 +0000 (UTC)
From: "Kam Kasravi (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12654627.1372118867801.176025.1372261220363@arcas>
In-Reply-To: <JIRA.12654627.1372118867801@arcas>
References: <JIRA.12654627.1372118867801@arcas>
Subject: [jira] [Reopened] (YARN-885) TestBinaryTokenFile (and others) fail
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/YARN-885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kam Kasravi reopened YARN-885:
------------------------------


This actually occurs on trunk and branch-2 and is the result of recent RPC changes due to Kyle Leckie when working on HADOOP-9621. The fix supplied by Vinod and Daryn was to not switch to simple if other auth methods were available such as tokens supplied by a secrets manager. However this still results in unit test failures and requires a patch I had made which sets IPC_CLIENT_FALLBACK_TO_SIMPLE_AUTH_ALLOWED_KEY in the ContainerLocalizer constructor and adds the creds tokens to the local context in ContainerLocalizer.runLocalization just like they're added to the user context in the same method. I'll upload the patch later today.
                
> TestBinaryTokenFile (and others) fail
> -------------------------------------
>
>                 Key: YARN-885
>                 URL: https://issues.apache.org/jira/browse/YARN-885
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.0.4-alpha
>            Reporter: Kam Kasravi
>
> Seeing the following stack trace and the unit test goes into a infinite loop:
> 2013-06-24 17:03:58,316 ERROR [LocalizerRunner for container_1372118631537_0001_01_000001] security.UserGroupInformation (UserGroupInformation.java:doAs(1480)) - PriviledgedActionException as:kamkasravi (auth:SIMPLE) cause:java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.
> 2013-06-24 17:03:58,317 WARN  [LocalizerRunner for container_1372118631537_0001_01_000001] ipc.Client (Client.java:run(579)) - Exception encountered while connecting to the server : java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.
> 2013-06-24 17:03:58,318 ERROR [LocalizerRunner for container_1372118631537_0001_01_000001] security.UserGroupInformation (UserGroupInformation.java:doAs(1480)) - PriviledgedActionException as:kamkasravi (auth:SIMPLE) cause:java.io.IOException: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.
> java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
>         at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:56)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:247)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:181)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:103)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:859)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira