giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rui Sarmento <rui_sarme...@hotmail.com>
Subject RE: Problem Building Apache Giraph Formats
Date Sat, 15 Dec 2012 14:54:05 GMT


Tried with the new jvm and the problem is the same...
Here goes my Hadoop version, and I'm running pseudo-distributed node.
[110414015@hpcgrid-centos6 ~]$ hadoop versionHadoop 0.20.2-cdh3u5
I see many test failures and map 0% reduce 0% passing by with the output of tests...
I really want to use Giraph but I'm getting somewhat unmotivated to use it with all this problems,
please advise...

From: nitay.joffe@gmail.com
Subject: Re: Problem Building Apache Giraph Formats
Date: Sat, 15 Dec 2012 00:21:39 -0800
To: user@giraph.apache.org

That's a different problem. Can you try just "mvn clean install" with the new jvm?

On Dec 14, 2012, at 5:24 AM, Rui Sarmento <rui_sarmento@hotmail.com> wrote:Hi,
I've just installed the (Oracle) jvm 1.7.0.10 
Unfortunately the problem remains the same:

[110414015@hpcgrid-centos6 trunk]$ mvn install -rf :giraph-formats-contrib[INFO] Scanning
for projects...[INFO][INFO] ------------------------------------------------------------------------[INFO]
Building Apache Giraph Formats 0.2-SNAPSHOT[INFO] ------------------------------------------------------------------------[WARNING]
The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing, no dependency information
available[WARNING] Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository
(file:../../local.repository/trunk): No connector available to access repository local.repository
(file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory[WARNING]
Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was
cached in the local repository, resolution will not be reattempted until the update interval
of local.repository has elapsed or updates are forced. Original error: Could not transfer
metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk):
No connector available to access repository local.repository (file:../../local.repository/trunk)
of type legacy using the available factories WagonRepositoryConnectorFactoryDownloading: http://repo1.maven.org/maven2/org/apache/giraph/giraph/0.2-SNAPSHOT/giraph-0.2-SNAPSHOT.jarDownloading:
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/giraph/giraph/0.2-SNAPSHOT/giraph-0.2-SNAPSHOT.jarDownloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/giraph/giraph/0.2-SNAPSHOT/giraph-0.2-SNAPSHOT.jarDownloading:
http://www.datanucleus.org/downloads/maven2/org/apache/giraph/giraph/0.2-SNAPSHOT/giraph-0.2-SNAPSHOT.jar[INFO]
------------------------------------------------------------------------[INFO] BUILD FAILURE[INFO]
------------------------------------------------------------------------[INFO] Total time:
3.921s[INFO] Finished at: Fri Dec 14 13:19:28 WET 2012[INFO] Final Memory: 11M/824M[INFO]
------------------------------------------------------------------------[ERROR] Failed to
execute goal on project giraph-formats-contrib: Could not resolve dependencies for project
org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: The following artifacts could not
be resolved: org.apache.giraph:giraph:jar:0.2-SNAPSHOT, org.apache.giraph:giraph:jar:tests:0.2-SNAPSHOT:
Could not find artifact org.apache.giraph:giraph:jar:0.2-SNAPSHOT in central (http://repo1.maven.org/maven2)
-> [Help 1][ERROR][ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.[ERROR] Re-run Maven using the -X switch to enable full debug logging.[ERROR][ERROR]
For more information about the errors and possible solutions, please read the following articles:[ERROR]
[Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException[110414015@hpcgrid-centos6
trunk]$

Regards,
Rui

From: nitay.joffe@gmail.com
Subject: Re: Problem Building Apache Giraph Formats
Date: Thu, 13 Dec 2012 10:42:29 -0800
To: user@giraph.apache.org

Can you try it with Java 1.6 and/or Java 1.7.0_9/10?
On Dec 13, 2012, at 7:57 AM, Rui Sarmento <rui_sarmento@hotmail.com> wrote:Here is the
output for java version:
[110414015@hpcgrid-centos6 ~]$ java -versionjava version "1.7.0_03"Java(TM) SE Runtime Environment
(build 1.7.0_03-b04)Java HotSpot(TM) 64-Bit Server VM (build 22.1-b02, mixed mode)
Hope it helps.
Rui
From: nitay.joffe@gmail.com
Subject: Re: Problem Building Apache Giraph Formats
Date: Thu, 13 Dec 2012 02:18:02 -0800
To: user@giraph.apache.org

Odd that should be far more than enough. I run the tests fine on my 8GB laptop.What JVM are
you using?
On Dec 1, 2012, at 4:02 PM, Rui Sarmento <rui_sarmento@hotmail.com> wrote:Any advise
on how to get things working?I'm working on a 12 core 55GB memory machine FYI. Do you need
more information from me to close this thread?

Rui
From: nitay.joffe@gmail.com
Subject: Re: Problem Building Apache Giraph Formats
Date: Tue, 27 Nov 2012 15:53:42 -0800
To: user@giraph.apache.org

>From cursory look it seems to me like all the failures are due to memory issues (OOME)
On Nov 27, 2012, at 1:54 PM, Rui Sarmento <rui_sarmento@hotmail.com> wrote:Sorry not
800, its more than 80 :-) .  I'm on the right dir.

> Date: Tue, 27 Nov 2012 22:16:08 +0100
> Subject: Re: Problem Building Apache Giraph Formats
> From: efeshundertelf@googlemail.com
> To: user@giraph.apache.org
> 
> Hi Rui!
> 
> from where are you running this? The test-results are on
> target/munged/surefire-reports. Please go into that directory and grep
> for ERROR.
> 
> --André
> 
> 2012/11/27 Rui Sarmento <rui_sarmento@hotmail.com>:
> > I'm using "grep -R -l" command but is taking to long, any advise for another
> > command? Is there a faster one available, its more than 800 documents.
> >
> > Thanks,
> >
> > Rui
> >
> > ________________________________
> > From: alessandro@fb.com
> > To: user@giraph.apache.org
> > Subject: Re: Problem Building Apache Giraph Formats
> > Date: Tue, 27 Nov 2012 02:05:18 +0000
> >
> >
> > You could take a look at surefire-reports and post the failing test(s).
> > Search for the string "error" in that folder.
> >
> > From: Rui Sarmento <rui_sarmento@hotmail.com>
> > Reply-To: "user@giraph.apache.org" <user@giraph.apache.org>
> > Date: Monday, November 26, 2012 5:58 PM
> > To: Giraph Support <user@giraph.apache.org>
> > Subject: RE: Problem Building Apache Giraph Formats
> >
> > running "mvn install" on trunk dir gives this result:
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Apache Giraph Parent .............................. SUCCESS [0.563s]
> > [INFO] Apache Giraph ..................................... FAILURE
> > [2:23.047s]
> > [INFO] Apache Giraph Formats ............................. SKIPPED
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD FAILURE
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 2:23.882s
> > [INFO] Finished at: Tue Nov 27 01:54:17 WET 2012
> > [INFO] Final Memory: 27M/811M
> > [INFO]
> > ------------------------------------------------------------------------
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-surefire-plugin:2.6:test (default-test) on
> > project giraph: There are test failures.
> > [ERROR]
> > [ERROR] Please refer to
> > /home/110414015/trunk/giraph/target/munged/surefire-reports for the
> > individual test results.
> > [ERROR] -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions, please
> > read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR] mvn <goals> -rf :giraph
> >
> > Do you need any test result in particular?
> >
> > Regards
> >
> > ________________________________
> > From: alessandro@fb.com
> > To: user@giraph.apache.org
> > Subject: Re: Problem Building Apache Giraph Formats
> > Date: Tue, 27 Nov 2012 01:37:39 +0000
> >
> > The actual error seems to be:
> >
> > [ERROR] Failed to execute goal on project giraph-formats-contrib: Could not
> > resolve dependencies for project
> > org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find
> > org.apache.giraph:giraph:jar:tests:0.2-SNAPSHOT
> > inhttp://repo1.maven.org/maven2 was cached in the local repository,
> > resolution will not be reattempted until the update interval of central has
> > elapsed or updates are forced -> [Help 1]
> >
> > Try running "mvn install" at the top level first. That should put the test
> > jar in your local repository.
> >
> > From: Rui Sarmento <rui_sarmento@hotmail.com>
> > Reply-To: "user@giraph.apache.org" <user@giraph.apache.org>
> > Date: Monday, November 26, 2012 5:15 PM
> > To: Giraph Support <user@giraph.apache.org>
> > Subject: RE: Problem Building Apache Giraph Formats
> >
> > Hi Alessandro,
> >
> > The command is "mvn compile", Everything compiles with success except Apache
> > Giraph Formats
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Building Apache Giraph Formats 0.2-SNAPSHOT
> > [INFO]
> > ------------------------------------------------------------------------
> > [WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing,
> > no dependency information available
> > [WARNING] Could not transfer metadata asm:asm/maven-metadata.xml from/to
> > local.repository (file:../../local.repository/trunk): No connector available
> > to access repository local.repository (file:../../local.repository/trunk) of
> > type legacy using the available factories WagonRepositoryConnectorFactory
> > [WARNING] Failure to transfer asm:asm/maven-metadata.xml from
> > file:../../local.repository/trunk was cached in the local repository,
> > resolution will not be reattempted until the update interval of
> > local.repository has elapsed or updates are forced. Original error: Could
> > not transfer metadata asm:asm/maven-metadata.xml from/to local.repository
> > (file:../../local.repository/trunk): No connector available to access
> > repository local.repository (file:../../local.repository/trunk) of type
> > legacy using the available factories WagonRepositoryConnectorFactory
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Apache Giraph Parent .............................. SUCCESS [0.002s]
> > [INFO] Apache Giraph ..................................... SUCCESS [10.759s]
> > [INFO] Apache Giraph Formats ............................. FAILURE [0.362s]
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD FAILURE
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 11.381s
> > [INFO] Finished at: Wed Nov 21 15:34:39 WET 2012
> > [INFO] Final Memory: 22M/824M
> > [INFO]
> > ------------------------------------------------------------------------
> > [ERROR] Failed to execute goal on project giraph-formats-contrib: Could not
> > resolve dependencies for project
> > org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find
> > org.apache.giraph:giraph:jar:tests:0.2-SNAPSHOT
> > inhttp://repo1.maven.org/maven2 was cached in the local repository,
> > resolution will not be reattempted until the update interval of central has
> > elapsed or updates are forced -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions, please
> > read the following articles:
> > [ERROR] [Help
> > 1]http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR] mvn <goals> -rf :giraph-formats-contrib
> >
> >
> > Thanks,
> >
> > Rui
> >
> >
> > ________________________________
> > From: alessandro@fb.com
> > To: user@giraph.apache.org
> > Subject: Re: Problem Building Apache Giraph Formats
> > Date: Tue, 27 Nov 2012 00:57:48 +0000
> >
> > Hi Rui,
> >
> > The default profile shouldn't be 0.20.1. Are you running plain "mvn verify"
> > or something else?
> > Also, can you post the other error you're getting?
> >
> > Alessandro
> >
> > From: Rui Sarmento <rui_sarmento@hotmail.com>
> > Reply-To: "user@giraph.apache.org" <user@giraph.apache.org>
> > Date: Monday, November 26, 2012 2:46 PM
> > To: "user@giraph.apache.org" <user@giraph.apache.org>
> > Subject: FW: Problem Building Apache Giraph Formats
> >
> >
> > Hi,
> >
> > I'm trying to build giraph and I'm getting this error I don't know how to
> > correct it, maybe you can help, what are your thoughts about this:
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Building Apache Giraph Formats 0.2-SNAPSHOT
> > [INFO]
> > ------------------------------------------------------------------------
> > [WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing,
> > no dependency information available
> >
> > It also complains about maven repositories FYI.
> >
> > Thanks in Advance for your help. If more information is needed I'll be glad
> > to help.
> >
> > Regards,
> >
> > Rui
 		 	   		  
Mime
View raw message