giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <claudio.marte...@gmail.com>
Subject Re: ClassNotFoundException GiraphYarn Task with Giraph 1.1.0 for Hadoop 2.5.1
Date Tue, 16 Dec 2014 12:00:27 GMT
try specifying the jobtracker by hand, via mapreduce.jobtracker.address. if
no jobtracker is defined giraph will try to run locally. it's a
misconfiguration of your cluster.

On Tue, Dec 16, 2014 at 8:19 AM, Philipp Nolte <ptn@daslaboratorium.de>
wrote:
>
> Hello Roman, thanks for your answer.
>
> I built and installed Giraph 1.1.0 into my local repository using
>
> $ mvn clean install -DskipTests -Phadoop_2 -Dhadoop.version=2.5.1
>
> My jar containing my Giraph computation was built using the following
> pom.xml and running
>
> pom.xml: https://gist.github.com/ptnplanet/2d1def1605adff37a622
>
> I am using a default Hadoop 2.5.1 configuration.
>
> In my yarn-site.xml I’ve only got the yarn.resourcemanager.hostname set to
> „master“. I can verify using the resourcemanager’s web interface that all
> the nodemanagers are connected to the resourcemanager.
>
> My mapred-site.xml has mapreduce.framework.name set to „yarn“.
>
> I’ve got a Zookeeper running on „master“ and have set giraph.zkServerPort
> to 2181 and graph.zkList set to „master:2181“ in my giraph-site.xml.
>
> When not specifying the mapred.job.tracker property, I get a
> "checkLocalJobRunnerConfiguration: When using LocalJobRunner, must have
> only one worker since only 1 task at a time!“ error.
>
> There must be some misconfiguration somewhere. Hope you can help!
>
> Thanks in advance!
>
> Philipp
>
>
> Am 16.12.2014 um 03:17 schrieb Roman Shaposhnik <roman@shaposhnik.org>:
>
> On Sun, Dec 14, 2014 at 11:21 PM, Philipp Nolte <ptn@daslaboratorium.de>
> wrote:
>
> Maybe its just a configuration thing.
>
>
> How did you build Giraph in the first place? Also, what's
> your mapred-site.xml and yarn-site.xml in HADOOP_CONF_DIR?
>
> Finally, what version of Hadoop are you using? And from
> what vendor?
>
> I’ve tried running in giraph.SplitMasterWorker mode and its seems like
> hadoop is missing the worker nodes:
>
> Here is my command:
> $ hadoop jar
> giraphs-and-balloons-computation-0.0.1-for-hadoop-2.5.1-and-giraph-1.1.0-RC1-jar-with-dependencies.jar
>
>
> How did you build this JAR?
>
> -ca mapred.job.tracker=master:5431\
>
>
> If your Giraph installation has access to a correctly
> configured Hadoop client you really don't need this
> line.
>
> Thanks,
> Roman.
>
>
>

-- 
   Claudio Martella

Mime
View raw message