giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Placek (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-813) Compilation problems with Hadoop 2.2.0
Date Tue, 10 Dec 2013 00:52:07 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13843777#comment-13843777
] 

Placek commented on GIRAPH-813:
-------------------------------

My HADOOP_MAPRED_HOME was OK, but you were right about the "Unable to find class for GiraphApplicationMaster"
and the "-yj" parameter. Now it runs (o rather breaks) a little further. Yet, I still cannot
execute the examples (see below, I think the stdout is crutial).

In $HADOOP_HOME/logs/userlogs/<app id>/gam-stdout.log:
{code}
2013-12-10 01:28:57,920 INFO  [main] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:main(421))
- Starting GitaphAM 
2013-12-10 01:28:59,351 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62))
- Unable to load native-hadoop library for your platform... using builtin-java classes where
applicable
2013-12-10 01:29:00,269 ERROR [main] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:main(437))
- GiraphApplicationMaster caught a top-level exception in main.
java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/lib/output/TextOutputFormat
	at java.lang.ClassLoader.defineClass1(Native Method)
	at java.lang.ClassLoader.defineClass(ClassLoader.java:791)
	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
	at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
	at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1659)
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1624)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1718)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1744)
	at org.apache.giraph.conf.ClassConfOption.get(ClassConfOption.java:128)
	at org.apache.giraph.conf.GiraphClasses.<init>(GiraphClasses.java:178)
	at org.apache.giraph.conf.ImmutableClassesGiraphConfiguration.<init>(ImmutableClassesGiraphConfiguration.java:121)
	at org.apache.giraph.yarn.GiraphApplicationMaster.<init>(GiraphApplicationMaster.java:158)
	at org.apache.giraph.yarn.GiraphApplicationMaster.main(GiraphApplicationMaster.java:431)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.lib.output.TextOutputFormat
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
	... 23 more
{code}

In $HADOOP_HOME/logs/userlogs/<app id>/gam-stderr.log:
{code}
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/hadoop-jsroka/nm-local-dir/usercache/jsroka/appcache/application_1386621700059_0010/filecache/11/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jsroka/hadoop/yarn_giraph/hadoop-2.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
{code}

> Compilation problems with Hadoop 2.2.0
> --------------------------------------
>
>                 Key: GIRAPH-813
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-813
>             Project: Giraph
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 1.1.0
>         Environment: >hadoop version
> Hadoop 2.2.0
> Subversion https://svn.apache.org/repos/asf/hadoop/common -r 1529768
> Compiled by hortonmu on 2013-10-07T06:28Z
> Compiled with protoc 2.5.0
> From source with checksum 79e53ce7994d1628b240f09af91e1af4
>            Reporter: Placek
>
> Is this a known issue?Running the code:
> -----------------------
> git clone git://git.apache.org/giraph.git snapshot_from_git
> cd snapshot_from_git
> mvn -Phadoop_yarn -Dhadoop.version=2.2.0 clean package -DskipTests
> Produces:
> -------------
> Cloning into 'snaphot_from_git'...
> remote: Counting objects: 16809, done.
> remote: Compressing objects: 100% (7476/7476), done.
> remote: Total 16809 (delta 9496), reused 11044 (delta 6199)
> Receiving objects: 100% (16809/16809), 21.95 MiB | 4.39 MiB/s, done.
> Resolving deltas: 100% (9496/9496), done.
> [INFO] Scanning for projects...
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Build Order:
> [INFO] 
> [INFO] Apache Giraph Parent
> [INFO] Apache Giraph Core
> [INFO] Apache Giraph Examples
> [INFO] Apache Giraph Distribution
> [INFO]                                                                         
> [INFO] ------------------------------------------------------------------------
> [INFO] Building Apache Giraph Parent 1.1.0-SNAPSHOT
> [INFO] ------------------------------------------------------------------------
> [INFO] 
> [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ giraph-parent ---
> [INFO] 
> [INFO] --- mavanagaiata:0.5.0:branch (git-commit) @ giraph-parent ---
> [INFO] 
> [INFO] --- mavanagaiata:0.5.0:commit (git-commit) @ giraph-parent ---
> [INFO] 
> [INFO] --- maven-enforcer-plugin:1.2:enforce (default) @ giraph-parent ---
> [INFO] Skipping Rule Enforcement.
> [INFO] 
> [INFO] --- maven-dependency-versions-check-plugin:2.0.2:check (default) @ giraph-parent
---
> [INFO] Checking dependency versions
> [ERROR] Found a problem with the dependency commons-httpclient:commons-httpclient
>   Resolved version is 3.0.1
>   Version 3.1 was expected by artifact: org.apache.hadoop:hadoop-common
> [ERROR] Found a problem with the dependency commons-logging:commons-logging
>   Resolved version is 1.0.4
>   Version 1.1.1 was expected by artifact: org.apache.hadoop:hadoop-common
> [ERROR] Found a problem with the dependency io.netty:netty
>   Resolved version is 3.5.3.Final
>   Version 3.6.2.Final was expected by artifacts: org.apache.hadoop:hadoop-mapreduce-client-common,
org.apache.hadoop:hadoop-mapreduce-client-core, org.apache.hadoop:hadoop-yarn-common, org.apache.hadoop:hadoop-yarn-server-common,
org.apache.hadoop:hadoop-yarn-server-nodemanager, org.apache.hadoop:hadoop-yarn-server-resourcemanager,
org.apache.hadoop:hadoop-yarn-server-tests:test-jar
> [ERROR] Found a problem with the dependency org.apache.zookeeper:zookeeper
>   Resolved version is 3.3.3
>   Version 3.4.5 was expected by artifacts: org.apache.hadoop:hadoop-common, org.apache.hadoop:hadoop-mapreduce-client-common,
org.apache.hadoop:hadoop-yarn-server-common, org.apache.hadoop:hadoop-yarn-server-nodemanager,
org.apache.hadoop:hadoop-yarn-server-resourcemanager, org.apache.hadoop:hadoop-yarn-server-tests:test-jar
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Apache Giraph Parent .............................. FAILURE [14.980s]
> [INFO] Apache Giraph Core ................................ SKIPPED
> [INFO] Apache Giraph Examples ............................ SKIPPED
> [INFO] Apache Giraph Distribution ........................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 16.684s
> [INFO] Finished at: Mon Dec 09 04:42:08 CET 2013
> [INFO] Final Memory: 23M/334M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal com.ning.maven.plugins:maven-dependency-versions-check-plugin:2.0.2:check
(default) on project giraph-parent: Found dependency version conflicts -> [Help 1]
> [ERROR] 
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the
following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message