giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eugene Koontz <ekoo...@hiro-tan.org>
Subject Re: Compiling Giraph for Hadoop 2.5.x and 2.6.0 -- SASL_PROPS variable error
Date Sat, 10 Jan 2015 18:38:14 GMT
Hi Allesio and Eli,

Compiling with "mvn -Phadoop_yarn -Dhadoop.version=2.6.0 clean" will 
avoid the below "SASL_PROPS" compilation error if you remove the 
STATIC_SASL_SYMBOL from the munge.symbols of the hadoop_yarn profile as 
follows:

diff --git a/pom.xml b/pom.xml
index cf0e1f9..8c2a561 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1194,7 +1194,7 @@ under the License.
        </modules>
        <properties>
<hadoop.version>SET_HADOOP_VERSION_USING_MVN_DASH_D_OPTION</hadoop.version>
- <munge.symbols>PURE_YARN,STATIC_SASL_SYMBOL</munge.symbols>
+        <munge.symbols>PURE_YARN</munge.symbols>
          <!-- TODO: add these checks eventually -->
<project.enforcer.skip>true</project.enforcer.skip>
<giraph.maven.dependency.plugin.skip>true</giraph.maven.dependency.plugin.skip>

In other words, when compiling Giraph against newer releases of Hadoop, 
there is no need for this munge symbol.

The distinction between newer and older seems to be release 2.4.0 of 
Hadoop, as given here:

https://issues.apache.org/jira/browse/HADOOP-10221 " Add a plugin to 
specify SaslProperties for RPC protocol based on connection properties".

  It seems like we need to add some additional profiles to make the 
pre-2.4 Hadoop (which requires the munge symbol STATIC_SASL_SYMBOL) and 
newer (which should not).

-Eugene


On 1/8/15, 11:13 PM, Eugene Koontz wrote:
> Hi Alessio,
>
> I am able to reproduce your problem:
>
> https://gist.github.com/ekoontz/7dbaaf6218abb4fd7832
>
> I'll try building Hadoop 2.6.0 and getting Giraph to work with it.
>
> -Eugene
>
>
> On 1/8/15, 10:55 AM, Eli Reisman wrote:
>> This looks like a munge symbol that needs to be added to the 
>> hadoop_yarn profile in the pom.xml. I'm thinking this is an issue a 
>> couple people have been having on 2.5 and 2.6 trying to build the 
>> hadoop_yarn profile?
>>
>> On Thu, Dec 4, 2014 at 1:01 PM, Dr. Alessio Arleo 
>> <ingarleo@icloud.com <mailto:ingarleo@icloud.com>> wrote:
>>
>>     Hello everybody
>>
>>     I am trying to compile Giraph release-1.1 for Hadoop 2.5.x and
>>     Hadoop 2.6.0 with Maven profile hadoop_yarn. It works fine up to
>>     Hadoop 2.4.1, but when trying with a newer version of Hadoop the
>>     following error comes up. I am working with jdk 1.7 and Maven 3.2.1.
>>     ST
>>     [ERROR] COMPILATION ERROR :
>>     [INFO] -------------------------------------------------------------
>>     [ERROR]
>>     /home/hadoop/git/giraph/1.1/giraph-core/target/munged/main/org/apache/giraph/comm/netty/SaslNettyClient.java:[84,68]
>>     cannot find symbol
>>       symbol:   variable SASL_PROPS
>>       location: class org.apache.hadoop.security.SaslRpcServer
>>     [ERROR]
>>     /home/hadoop/git/giraph/1.1/giraph-core/target/munged/main/org/apache/giraph/comm/netty/SaslNettyServer.java:[105,62]
>>     cannot find symbol
>>       symbol:   variable SASL_PROPS
>>       location: class org.apache.hadoop.security.SaslRpcServer
>>
>>     Do you have any suggestions? Any would be much appreciated :)
>>
>>     Kind regards,
>>     Alessio
>>
>>
>


Mime
View raw message