ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hurley (JIRA)" <>
Subject [jira] [Updated] (AMBARI-22245) YARN Service Checks Fails Because of Old hadoop-client Classpath Entry
Date Mon, 16 Oct 2017 19:36:00 GMT


Jonathan Hurley updated AMBARI-22245:
    Status: Patch Available  (was: Open)

> YARN Service Checks Fails Because of Old hadoop-client Classpath Entry
> ----------------------------------------------------------------------
>                 Key: AMBARI-22245
>                 URL:
>             Project: Ambari
>          Issue Type: Bug
>    Affects Versions: 2.6.0
>            Reporter: Jonathan Hurley
>            Assignee: Jonathan Hurley
>            Priority: Blocker
>             Fix For: 2.6.0
>         Attachments: AMBARI-22245.patch
> STR:
> - Install basic YARN on HDP (no Tez)
> - Upgrade just YARN to HDP
> Service checks will fail with the following:
> {code}
> 17/10/12 17:55:20 FATAL distributedshell.ApplicationMaster: Error running ApplicationMaster
> java.lang.NoSuchMethodError:;)Lorg/apache/hadoop/io/retry/RetryPolicy;
> 	at org.apache.hadoop.yarn.client.RMProxy.createRetryPolicy(
> {code}
> - All YARN daemons and clients are reporting
> - All YARN daemons have loaded JARs for
> What is happening here is that the applications being run on YARN are picking up the
older hadoop-common JAR file. The method {{retryForeverWithFixedSleep}} did not exist in HDP
> It is picking up the older JARs for running applications because of the {{yarn-site.xml}}
> {code}
> yarn-site.xml-      <name>yarn.application.classpath</name>
> yarn-site.xml:      <value>/etc/hadoop/conf,/usr/hdp/current/hadoop-client/*,/usr/hdp/current/hadoop-client/lib/*,/usr/hdp/current/hadoop-hdfs-client/*,/usr/hdp/current/hadoop-hdfs-client/lib/*,/usr/hdp/current/hadoop-yarn-client/*,/usr/hdp/current/hadoop-yarn-client/lib/*,/usr/hdp/current/ext/hadoop/*</value>
> {code}
> Ambari should be parameterizing the {{/usr/hdp/current/hadoop-client}} paths here. 
> Whether or not this is an actual bug is debatable. We know that hadoop-client would not
be moving along with YARN and we were guaranteed that hadoop-client would be 100% backward
compatible. In this case, it's not because I was using a pre-release version of The
same test from to succeeds. We were also told that if hadoop-client needed
a change, then it's basically a full upgrade anyway.

This message was sent by Atlassian JIRA

View raw message