spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-23982) NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil
Date Mon, 16 Apr 2018 00:53:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-23982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16438895#comment-16438895
] 

John commented on SPARK-23982:
------------------------------

see spark-core_2.11-2.3.0 and spark-yarn_2.11-2.3.0

org.apache.spark.executor.CoarseGrainedExecutorBackend:

if (driverConf.contains("spark.yarn.credentials.file")) {
  logInfo("Will periodically update credentials from: " +
    driverConf.get("spark.yarn.credentials.file"))
  Utils.classForName("org.apache.spark.deploy.yarn.YarnSparkHadoopUtil")
    .getMethod("startCredentialUpdater", classOf[SparkConf])
    .invoke(null, driverConf)
}

 

> NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil
> --------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-23982
>                 URL: https://issues.apache.org/jira/browse/SPARK-23982
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.3.0
>            Reporter: John
>            Priority: Major
>
>  In the 219 line of the CoarseGrainedExecutorBackend class:
> Utils.classForName("org.apache.spark.deploy.yarn.YarnSparkHadoopUtil").getMethod("startCredentialUpdater",
classOf[SparkConf]).invoke(null, driverConf)
> But, There is no startCredentialUpdater method in the object YarnSparkHadoopUtil.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message