giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (GIRAPH-629) YARN profile is broken when compiled against hadoop-2.0.4
Date Sun, 14 Apr 2013 16:54:15 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eli Reisman resolved GIRAPH-629.
--------------------------------

    Resolution: Won't Fix

As is stated in the final Giraph-13 stuff, The hadoop version is currently hardcoded to 2.0.3
and while we can upgrade this by hand in the POMs there is no setup to move it from code yet.
I would suggest a new JIRA to reconfigure the POM to accept this.

My "dream" was to have the build do something on the order of:

{code}
mvn -Phadoop_yarn,HADOOPVERSION clean install
{code}

where "HADOOPVERSION" would be the name of one of our other profiles, so that you could pick
at the command line and have it blow up if the versioning made no sense (as 0.20.x would etc)
but due to strange behavior in the filtering (I can't try to compile the YARN code against
hadoop versions that do not supply it) this was not possible.

so option two (which might be possible) is something like this:

{code}
mvn -Phadoop_yarn -Dhadoop.version=HADOOPVERSION clean install
{code}

however early attempts to do this indicate that the POM hadoop-version is being overridden
at times in our build by sub-project POM's or not propagating correctly to allow it. I ran
out of time at HW to handle this, but if I didn't put up a JIRA for it already (I think I
did) then we should have one, this seems like it could be done and would work.

Anyway, because this behavior (only allowing 2.0.3) is "normal" for now, I'm resolving this
particular JIRA as "won't fix"
                
> YARN profile is broken when compiled against hadoop-2.0.4
> ---------------------------------------------------------
>
>                 Key: GIRAPH-629
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-629
>             Project: Giraph
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 1.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>
> {noformat}
> $ mvn -Phadoop_yarn -DskipTests -Dhadoop.version=2.0.4-SNAPSHOT clean package
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Apache Giraph Parent .............................. SUCCESS [1.359s]
> [INFO] Apache Giraph Core ................................ FAILURE [15.319s]
> [INFO] Apache Giraph Hive I/O ............................ SKIPPED
> [INFO] Apache Giraph Examples ............................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 17.374s
> [INFO] Finished at: Fri Apr 12 17:21:11 PDT 2013
> [INFO] Final Memory: 39M/481M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.0:compile
(default-compile) on project giraph-core: Compilation failure: Compilation failure:
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[46,42]
cannot find symbol
> [ERROR] symbol  : class AMResponse
> [ERROR] location: package org.apache.hadoop.yarn.api.records
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[206,42]
cannot find symbol
> [ERROR] symbol  : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[291,47]
cannot find symbol
> [ERROR] symbol  : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[368,11]
cannot find symbol
> [ERROR] symbol  : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[398,35]
cannot find symbol
> [ERROR] symbol  : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[178,7]
cannot find symbol
> [ERROR] symbol  : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[255,26]
cannot find symbol
> [ERROR] symbol  : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[296,37]
cannot find symbol
> [ERROR] symbol  : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[327,49]
cannot find symbol
> [ERROR] symbol  : method getState()
> [ERROR] location: interface org.apache.hadoop.yarn.api.records.Container
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[349,46]
cannot find symbol
> [ERROR] symbol  : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[353,42]
cannot find symbol
> [ERROR] symbol  : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[379,7]
cannot find symbol
> [ERROR] symbol  : class AMResponse
> [ERROR] location: class org.apache.giraph.yarn.GiraphApplicationMaster
> [ERROR] /tmp/giraph/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphApplicationMaster.java:[379,44]
cannot find symbol
> [ERROR] symbol  : method getAMResponse()
> [ERROR] location: interface org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
> [ERROR] -> [Help 1]
> [ERROR] 
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the
following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR] 
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR]   mvn <goals> -rf :giraph-core
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message