giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koontz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-590) Missing class org.apache.commons.net.util.Base64
Date Tue, 26 Mar 2013 15:07:15 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13614093#comment-13614093
] 

Eugene Koontz commented on GIRAPH-590:
--------------------------------------

Hi Gianmarco,

I see in the top-level pom.xml that the 0.23 profile has:

    <dependency>
          <groupId>commons-net</groupId>
          <artifactId>commons-net</artifactId>
    </dependency>

whereas 2.0-series Hadoops have:

   <dependency>
        <groupId>commons-net</groupId>
        <artifactId>commons-net</artifactId>
        <scope>provided</scope>
        <version>3.1</version>
    </dependency>

Perhaps changing the 0.23 profile to use the latter would fix this?

Or try adding to your yarn-site.xml: 

 <property>
    <name>yarn.application.classpath</name>
    <value>(path to the commons-net jar)</value>
 </property>

-Eugene

                
> Missing class org.apache.commons.net.util.Base64
> ------------------------------------------------
>
>                 Key: GIRAPH-590
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-590
>             Project: Giraph
>          Issue Type: Bug
>         Environment: Hadoop_0.23, -Dgiraph.useNetty=true, -Dgiraph.authenticate=true
>            Reporter: Gianmarco De Francisci Morales
>
> I get the following exception when my mappers start:
> {code}
> 2013-03-26 10:31:18,176 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running
child : java.lang.NoClassDefFoundError: org/apache/commons/net/util/Base64
> 	at org.apache.giraph.comm.netty.SaslNettyServer.encodeIdentifier(SaslNettyServer.java:124)
> 	at org.apache.giraph.comm.netty.SaslNettyClient$SaslClientCallbackHandler.<init>(SaslNettyClient.java:167)
> 	at org.apache.giraph.comm.netty.SaslNettyClient.<init>(SaslNettyClient.java:77)
> 	at org.apache.giraph.comm.netty.NettyClient.authenticateOnChannel(NettyClient.java:504)
> 	at org.apache.giraph.comm.netty.NettyClient.authenticate(NettyClient.java:479)
> 	at org.apache.giraph.comm.netty.NettyWorkerClient.authenticate(NettyWorkerClient.java:176)
> 	at org.apache.giraph.comm.netty.NettyWorkerClient.setup(NettyWorkerClient.java:167)
> 	at org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:504)
> 	at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:225)
> 	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:92)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:726)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1221)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
> Caused by: java.lang.ClassNotFoundException: org.apache.commons.net.util.Base64
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
> 	... 17 more
> {code}
> Indeed, the class is not included in the giraph-core or giraph-examples fat jars, even
though I see commons-net listed in the pom.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message