hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prabhu Joseph <prabhujose.ga...@gmail.com>
Subject Long running Spark job on YARN throws "No AMRMToken"
Date Tue, 09 Feb 2016 04:34:57 GMT
Hi All,

    A long running Spark job on YARN throws below exception after running
for few days.

yarn.ApplicationMaster: Reporter thread fails 1 time(s) in a row.
org.apache.hadoop.yarn.exceptions.YarnException: *No AMRMToken found* for
user prabhu at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUti

Do any of the below renew the AMRMToken and solve the issue

1. yarn-resourcemanager.delegation.token.max-lifetime increase from 7 days

2. Configuring Proxy user:

<property> <name>hadoop.proxyuser.yarn.hosts</name> <value>*</value>
<property> <name>hadoop.proxyuser.yarn.groups</name> <value>*</value>

3. Can Spark-1.4.0 handle with fix


How to renew the AMRMToken for a long running job on YARN?

Prabhu Joseph

View raw message