Mailing-List: contact user-help@giraph.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@giraph.apache.org
Received-SPF: error (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <CAKPcKA5qU6hb8LjAX+CaJvRDUhDvNgN8XPX0CLf4x3Z9-kwwZg@mail.gmail.com>
References: 
 <CAKPcKA5qU6hb8LjAX+CaJvRDUhDvNgN8XPX0CLf4x3Z9-kwwZg@mail.gmail.com>
From: Steven Harenberg <sdharenb@ncsu.edu>
Date: Mon, 23 Mar 2015 09:26:39 -0400
Message-ID: 
 <CAHv2BaxULaBV8Vj4YqEaWRr3NnGw0y7MAGjwgKf1527JaqNv=g@mail.gmail.com>
Subject: Re: Giraph 1.1.0 not running on full cluster with Hadoop 2.6.0
To: user <user@giraph.apache.org>
Content-Type: multipart/alternative; boundary=047d7b5d4808e9b74a0511f49e44

--047d7b5d4808e9b74a0511f49e44
Content-Type: text/plain; charset=UTF-8

Try adding this option: -ca giraph.SplitMasterWorker=false

--Steve

On Sun, Mar 22, 2015 at 4:28 PM, Kenrick Fernandes <kenrick.f15@gmail.com>
wrote:

> Hi,
>
> I am working with Giraph 1.1.0 and a YARN cluster with Hadoop 2.6.0.
> I build Giraph with
>      mvn -Phadoop_2 -Dhadoop.version=2.6.0 clean package -DskipTests
>
> So far, when I run any of the benchmarks or Shortest path examples, I
> always get the LocalJobRunner error :
>
>
>
> ---------------------------------------------------------------------------------------
> Exception in thread "main" java.lang.IllegalArgumentException:
> checkLocalJobRunnerConfiguration: When using LocalJobRunner, you cannot run
> in split master / worker mode since there is only 1 task at a time!
> at
> org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:168)
> at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:236)
> at org.apache.giraph.benchmark.GiraphBenchmark.run(GiraphBenchmark.java:96)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at
> org.apache.giraph.benchmark.PageRankBenchmark.main(PageRankBenchmark.java:158)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> -------------------------------------------------------------------
>
> I have tried some solutions from forums/StackOverflow/lists, but so far
> nothing has worked. As far as I can tell, Hadoop is configured right (other
> MR benchmarks run fine). I tried changing the above Giraph code file
> (making the check function returned what I wanted), but that only starts
> the Job and gets it running on a single machine - it never uses more than 1
> machine.
>
> Any help or pointers in the right direction would be much appreciated.
>
> Thanks,
> Kenrick
>

--047d7b5d4808e9b74a0511f49e44
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Try adding this option: -ca giraph.SplitMasterWorker=
=3Dfalse<br><br></div>--Steve<br><div><div class=3D"gmail_extra"><br><div c=
lass=3D"gmail_quote">On Sun, Mar 22, 2015 at 4:28 PM, Kenrick Fernandes <sp=
an dir=3D"ltr">&lt;<a href=3D"mailto:kenrick.f15@gmail.com" target=3D"_blan=
k">kenrick.f15@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmai=
l_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left=
:1ex"><div dir=3D"ltr">Hi,<div><br></div><div>I am working with Giraph 1.1.=
0 and a YARN cluster with Hadoop 2.6.0.</div><div>I build Giraph with=C2=A0=
</div><div>=C2=A0 =C2=A0 =C2=A0mvn -Phadoop_2 -Dhadoop.version=3D2.6.0
clean package -DskipTests</div><div><br></div><div>So far, when I run any o=
f the benchmarks or Shortest path examples, I always get the LocalJobRunner=
 error :</div><div><br></div><div><br></div><div>--------------------------=
-------------------------------------------------------------</div><div><di=
v>Exception in thread &quot;main&quot; java.lang.IllegalArgumentException: =
checkLocalJobRunnerConfiguration: When using LocalJobRunner, you cannot run=
 in split master / worker mode since there is only 1 task at a time!</div><=
div><span style=3D"white-space:pre-wrap">	</span>at org.apache.giraph.job.G=
iraphJob.checkLocalJobRunnerConfiguration(GiraphJob.java:168)</div><div><sp=
an style=3D"white-space:pre-wrap">	</span>at org.apache.giraph.job.GiraphJo=
b.run(GiraphJob.java:236)</div><div><span style=3D"white-space:pre-wrap">	<=
/span>at org.apache.giraph.benchmark.GiraphBenchmark.run(GiraphBenchmark.ja=
va:96)</div><div><span style=3D"white-space:pre-wrap">	</span>at org.apache=
.hadoop.util.ToolRunner.run(ToolRunner.java:70)</div><div><span style=3D"wh=
ite-space:pre-wrap">	</span>at org.apache.hadoop.util.ToolRunner.run(ToolRu=
nner.java:84)</div><div><span style=3D"white-space:pre-wrap">	</span>at org=
.apache.giraph.benchmark.PageRankBenchmark.main(PageRankBenchmark.java:158)=
</div><div><span style=3D"white-space:pre-wrap">	</span>at sun.reflect.Nati=
veMethodAccessorImpl.invoke0(Native Method)</div><div><span style=3D"white-=
space:pre-wrap">	</span>at sun.reflect.NativeMethodAccessorImpl.invoke(Nati=
veMethodAccessorImpl.java:57)</div><div><span style=3D"white-space:pre-wrap=
">	</span>at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth=
odAccessorImpl.java:43)</div><div><span style=3D"white-space:pre-wrap">	</s=
pan>at java.lang.reflect.Method.invoke(Method.java:606)</div><div><span sty=
le=3D"white-space:pre-wrap">	</span>at org.apache.hadoop.util.RunJar.run(Ru=
nJar.java:221)</div><div><span style=3D"white-space:pre-wrap">	</span>at or=
g.apache.hadoop.util.RunJar.main(RunJar.java:136)</div></div><div>---------=
----------------------------------------------------------</div><div><br></=
div><div>I have tried some solutions from forums/StackOverflow/lists, but s=
o far nothing has worked. As far as I can tell, Hadoop is configured right =
(other MR benchmarks run fine). I tried changing the above Giraph code file=
 (making the check function returned what I wanted), but that only starts t=
he Job and gets it running on a single machine - it never uses more than 1 =
machine.=C2=A0</div><div><br></div><div>Any help or pointers in the right d=
irection would be much appreciated.</div><div><br></div><div>Thanks,<br>Ken=
rick=C2=A0</div></div>
</blockquote></div><br></div></div></div>

--047d7b5d4808e9b74a0511f49e44--