giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Young Han <young....@uwaterloo.ca>
Subject Re: compilation error of giraph
Date Wed, 22 Jan 2014 00:08:42 GMT
Hmm.. sorry no, I've only used Giraph with Apache Hadoop 1.0.4 myself. I
asked because of the "java.lang.NoClassDefFoundError:
org/apache/hadoop/io/Writable" lines in the output.

As per Owen's suggestion, I also needed to use -DskipTests to compile
successfully. Perhaps for Hadoop 2.0.4 you also need -Phadoop_2.0? So
something like:  mvn clean install -Phadoop_2.0 -DskipTests

Young


On Tue, Jan 21, 2014 at 5:34 PM, Rob Paul <urlop007@gmail.com> wrote:

> Hi Young,
>
> Appreciate the help. I do have hadoop in the path but its not the
> apache version of hadoop, but specific distribution of hadoop, built
> on top of apache hadoop, 2.0.4. Following command gives the attached
> output.
> cmd>hadoop version
> Hadoop 2.0.4-<distro_name>
> Subversion https://sh-ssvn.sh.<xxxxx>.com/ssg_repos/aaa -r 1089
>
> Do you know, if I need to make any change to use custom hadoop, which
> is built on top of the apache hadoop?
> Again, thanks for extending the help. Highly appreciated.
> Regards
> Rob
>
>
>
> On Tue, Jan 21, 2014 at 2:22 PM, Young Han <young.han@uwaterloo.ca> wrote:
> > Hi,
> >
> > Could it be that you're missing the path to Hadoop?
> >
> > Young
> >
> > On 2014-01-21 2:25 PM, "Rob Paul" <urlop007@gmail.com> wrote:
> >>
> >> Hi,
> >> Does anyone knows, what's missing? Why I can't compile giraph. I am
> >> new to Girah and sorry, if I am missing something very trivial.
> >> Regards
> >> Rob
> >> ===================Below is the error============================
> >>
> >> [INFO] Building jar:
> >>
> >>
> /home/rob/dev/apache/giraph-trunk/giraph/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> >> [INFO]
> >> [INFO] --- maven-antrun-plugin:1.6:run (default) @ giraph-core ---
> >> [INFO] Executing tasks
> >>
> >> main:
> >>      [java] java.lang.NoClassDefFoundError:
> org/apache/hadoop/io/Writable
> >>      [java]     at
> >> org.apache.tools.ant.taskdefs.ExecuteJava.execute(ExecuteJava.java:194)
> >>      [java]     at org.apache.tools.ant.taskdefs.Java.run(Java.java:771)
> >>      [java]     at
> >> org.apache.tools.ant.taskdefs.Java.executeJava(Java.java:221)
> >>      [java]     at
> >> org.apache.tools.ant.taskdefs.Java.executeJava(Java.java:135)
> >>      [java]     at
> >> org.apache.tools.ant.taskdefs.Java.execute(Java.java:108)
> >>      [java]     at
> >> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> >>      [java]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> >> Method)
> >>      [java]     at
> >>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >>      [java]     at
> >>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>      [java]     at java.lang.reflect.Method.invoke(Method.java:606)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> >>      [java]     at org.apache.tools.ant.Task.perform(Task.java:348)
> >>      [java]     at org.apache.tools.ant.Target.execute(Target.java:390)
> >>      [java]     at
> >> org.apache.tools.ant.Target.performTasks(Target.java:411)
> >>      [java]     at
> >> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
> >>      [java]     at
> >> org.apache.tools.ant.Project.executeTarget(Project.java:1366)
> >>      [java]     at
> >> org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270)
> >>      [java]     at
> >>
> >>
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106)
> >>      [java]     at
> >>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> >>      [java]     at
> >>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> >>      [java]     at
> >>
> >>
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> >>      [java]     at
> >>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> >>      [java]     at
> >>
> >>
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> >>      [java]     at
> >>
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> >>      [java]     at
> >>
> >>
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> >>      [java]     at
> >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:318)
> >>      [java]     at
> >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:153)
> >>      [java]     at
> >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
> >>      [java]     at
> org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
> >>      [java]     at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
> >>      [java]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> >> Method)
> >>      [java]     at
> >>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >>      [java]     at
> >>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>      [java]     at java.lang.reflect.Method.invoke(Method.java:606)
> >>      [java]     at
> >>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> >>      [java]     at
> >>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> >>      [java]     at
> >>
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:414)
> >>      [java]     at
> >>
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:357)
> >>      [java] Caused by: java.lang.NoClassDefFoundError:
> >> org/apache/hadoop/io/Writable
> >>      [java]     at java.lang.ClassLoader.defineClass1(Native Method)
> >>      [java]     at
> java.lang.ClassLoader.defineClass(ClassLoader.java:792)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070)
> >>      [java]     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> >>      [java]     at java.lang.ClassLoader.defineClass1(Native Method)
> >>      [java]     at
> java.lang.ClassLoader.defineClass(ClassLoader.java:792)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070)
> >>      [java]     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> >>      [java]     at java.lang.ClassLoader.defineClass1(Native Method)
> >>      [java]     at
> java.lang.ClassLoader.defineClass(ClassLoader.java:792)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295)
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070)
> >>      [java]     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> >>      [java]     at
> >>
> org.apache.giraph.conf.GiraphConstants.<clinit>(GiraphConstants.java:135)
> >>      [java]     at
> >> org.apache.giraph.conf.AllOptions.main(AllOptions.java:153)
> >>      [java]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> >> Method)
> >>      [java]     at
> >>
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >>      [java]     at
> >>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>      [java]     at java.lang.reflect.Method.invoke(Method.java:606)
> >>      [java]     at
> >> org.apache.tools.ant.taskdefs.ExecuteJava.run(ExecuteJava.java:217)
> >>      [java]     at
> >> org.apache.tools.ant.taskdefs.ExecuteJava.execute(ExecuteJava.java:152)
> >>      [java]     ... 37 more
> >>      [java] Caused by: java.lang.ClassNotFoundException:
> >> org.apache.hadoop.io.Writable
> >>      [java]     at
> >>
> >>
> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1361)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311)
> >>      [java]     at
> >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070)
> >>      [java]     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> >>      [java]     ... 69 more
> >>      [java] Java Result: -1
> >> [INFO] Executed tasks
> >> [INFO]
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] Reactor Summary:
> >> [INFO]
> >> [INFO] Apache Giraph Parent .............................. SUCCESS
> >> [7.474s]
> >> [INFO] Apache Giraph Core ................................ SUCCESS
> >> [1:02.431s]
> >> [INFO] Apache Giraph Examples ............................ FAILURE
> >> [0.312s]
> >> [INFO] Apache Giraph HBase I/O ........................... SKIPPED
> >> [INFO] Apache Giraph Accumulo I/O ........................ SKIPPED
> >> [INFO] Apache Giraph Rexster I/O ......................... SKIPPED
> >> [INFO] Apache Giraph HCatalog I/O ........................ SKIPPED
> >> [INFO] Apache Giraph Hive I/O ............................ SKIPPED
> >> [INFO] Apache Giraph Distribution ........................ SKIPPED
> >> [INFO] Apache Giraph Gora I/O ............................ SKIPPED
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] BUILD FAILURE
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] Total time: 1:12.383s
> >> [INFO] Finished at: Mon Jan 20 17:25:46 PST 2014
> >> [INFO] Final Memory: 31M/119M
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [ERROR] Failed to execute goal on project giraph-examples: Could not
> >> resolve dependencies for project
> >> org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: Failure to find
> >> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT in
> >> http://repo1.maven.org/maven2 was cached in the local repository,
> >> resolution will not be reattempted until the update interval of
> >> central has elapsed or updates are forced -> [Help 1]
>

Mime
View raw message