apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Munagala Ramanath <...@datatorrent.com>
Subject Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency
Date Thu, 23 Mar 2017 14:15:17 GMT
Looks like this was a breaking change introduced in Hadoop 2.7.0:

In
https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
we have:

static long DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
static String DELEGATION_TOKEN_MAX_LIFETIME_KEY

But in
https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
we have:

static long RM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
static String RM_DELEGATION_TOKEN_MAX_LIFETIME_KEY

Ram

On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar <chinmay@apache.org>
wrote:

> Hi All,
>
> I want to clarify whether my understanding is correct here.
>
> 1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
> 2. Extracted the tar
> 3. Ran following command to build apex core:
> mvn clean package -DskipTests -Dhadoop.version=2.7.3
> (NOTE: I have overridden hadoop version to 2.7.3)
>
> I get following compilation error:
> [ERROR] Failed to execute goal org.apache.maven.plugins:
> maven-compiler-plugin:3.3:compile (default-compile) on project
> apex-engine: Compilation failure: Compilation failure:
> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/
> main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87]
> cannot find symbol
> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/
> main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120]
> cannot find symbol
> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/
> main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173]
> cannot find symbol
> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR] -> [Help 1]
>
> What should be the expected result while building apex-core when building
> with different version of hadoop?
> Is this error expected OR something wrong in my environment?
>
> Thanks,
> Chinmay.
>
>


-- 

_______________________________________________________

Munagala V. Ramanath

Software Engineer

E: ram@datatorrent.com | M: (408) 331-5034 | Twitter: @UnknownRam

www.datatorrent.com  |  apex.apache.org

Mime
View raw message