Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 25 Jul 2016 18:37:20 +0000 (UTC)
From: "Kiran Miryala (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.12992363.1469471807000.126204.1469471840597@Atlassian.JIRA>
In-Reply-To: <JIRA.12992363.1469471807000@Atlassian.JIRA>
References: <JIRA.12992363.1469471807000@Atlassian.JIRA> <JIRA.12992363.1469471807014@arcas>
Subject: [jira] [Created] (HADOOP-13420) Hadoop standalone instance exits
 during starting an MR job with ExpiredTokenRemover error in log (after some
 time & after few jobs executed successfully)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 25 Jul 2016 18:37:22 -0000

Kiran Miryala created HADOOP-13420:
--------------------------------------

             Summary: Hadoop standalone instance exits during starting an MR job with ExpiredTokenRemover error in log (after some time & after few jobs executed successfully)
                 Key: HADOOP-13420
                 URL: https://issues.apache.org/jira/browse/HADOOP-13420
             Project: Hadoop Common
          Issue Type: Bug
         Environment: Ubuntu Desktop 16 LTE, jdk1.8.92 & Hadoop 2.7.2
            Reporter: Kiran Miryala


Hadoop/HDFS & Yarn processes exit (all jps deamons) and user is thrown out from session when it is running an MR job, after some interval (i.e. after few jobs completed successfully).

Error in log file: 2016-07-23 17:56:16,258 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted

Log file: /usr/local/hadoop/logs/yarn-hduser-resourcemanager-KMUbLptp.log

2016-07-23 17:56:14,044 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1469316920580_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2016-07-23 17:56:14,663 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1469316920580_0007
2016-07-23 17:56:16,201 ERROR org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: RECEIVED SIGNAL 15: SIGTERM
2016-07-23 17:56:16,258 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
2016-07-23 17:56:16,259 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8088
2016-07-23 17:56:16,284 ERROR org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: RECEIVED SIGNAL 15: SIGTERM
2016-07-23 17:56:16,360 INFO org.apache.hadoop.ipc.Server: Stopping server on 8032
2016-07-23 17:56:16,361 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8032
2016-07-23 17:56:16,361 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2016-07-23 17:56:16,362 INFO org.apache.hadoop.ipc.Server: Stopping server on 8033

This error is happens only after below terminal output entry :
16/07/23 17:56:13 INFO mapreduce.Job:  map 0% reduce 0%

Environment:
Ubuntu Desktop 16 LTE, jdk1.8.92 & Hadoop 2.7.2

Steps to reproduce:
(1)login (on terminal) using dedicated user hduser (a sudo user) using command: su hduser 
(2)start hadoop daemons using commands: start-dfs.sh & start-yarn.sh
(3)I can see all processes
(4)Few MR jobs completed successfully. Can try submit same job after about 10-15 min.
(5)This user is thrown out & land in regular desktop user session.

I think it could be some timeout, it works normally again if I restart my machine & start over again. I get same error if I follow the same steps on the same terminal session. 

I would appreciate if somebody has encountered this issue.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org