hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benson Qiu <benson....@salesforce.com>
Subject ApplicationReport.getDiagnostics doesn't contain "cause" of IOException
Date Wed, 09 Nov 2016 23:43:13 GMT
I am submitting a Spark job to YARN, which throws a YarnException in
YarnClientImpl
<https://github.com/apache/hadoop/blob/edf0d0f8b2115d4edb5d4932b5ecb15430d94c40/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java#L285>
.

`appReport.getDiagnostics()` contains an error message from
DelegationTokenRenewer.handleappSubmitEvent
<https://github.com/apache/hadoop/blob/f67237cbe7bc48a1b9088e990800b37529f1db2a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/security/DelegationTokenRenewer.java#L475>
.

The constructor used for IOException in this case is:
public IOException(String message, Throwable cause)

*The error message that I catch is:*
Failed to submit application_1478137633980_0247 to YARN : Failed to renew
token: Kind: HDFS_DELEGATION_TOKEN, Service:
<intentionally_omitted_service>, Ident: (HDFS_DELEGATION_TOKEN token 74784
for <intentionally_omitted_user>)

*This contains the "message" part of "public IOException(String message,
Throwable cause), but not the "cause" part. *Is there any way to see the
"cause" as well? This would really help me debug.

Any help would be really appreciated. Thanks in advance!

Regards,
Benson

Mime
View raw message