Mailing-List: contact giraph-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: giraph-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: David Garcia <dgarcia@potomacfusion.com>
To: "giraph-user@incubator.apache.org" <giraph-user@incubator.apache.org>
Date: Sun, 29 Jan 2012 22:13:48 -0600
Subject: Re: Vertex exists error when processing input splits for Sequence
 file
Thread-Topic: Vertex exists error when processing input splits for Sequence
 file
Thread-Index: AczfBY2lHJ00s6A0S+ulPUfj1+CCmw==
Message-ID: <CB4B750C.5ED8%dgarcia@potomacfusion.com>
In-Reply-To: <CB4B744D.5ED3%dgarcia@potomacfusion.com>
Accept-Language: en-US
Content-Language: en-US
user-agent: Microsoft-MacOutlook/14.14.0.111121
acceptlanguage: en-US
Content-Type: multipart/alternative;
	boundary="_000_CB4B750C5ED8dgarciapotomacfusioncom_"
MIME-Version: 1.0

--_000_CB4B750C5ED8dgarciapotomacfusioncom_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable


Hello, I get this error when I try run my job:

2012-01-29 21:50:18,494 INFO org.apache.giraph.graph.BspServiceWorker: rese=
rveInputSplit: reservedPath =3D null, 1 of 1 InputSplits are finished.
2012-01-29 21:50:18,494 INFO org.apache.giraph.graph.BspServiceWorker: setu=
p: Finally loaded a total of (v=3D0, e=3D0)
2012-01-29 21:50:18,764 INFO org.apache.giraph.graph.BspService: process: i=
nputSplitsAllDoneChanged (all vertices sent from input splits)
2012-01-29 21:50:18,766 ERROR org.apache.giraph.graph.GraphMapper: setup: C=
aught exception just before end of setup

java.lang.IllegalStateException: moveVerticesToWorker: Vertex Vertex(id=3Dz=
zYNBgKt2LF6ClLA2eMBzuN7SkA.,value=3Dorg.apache.hadoop.io.MapWritable@5ce878=
7a,#edges=3D0) already exists!
        at org.apache.giraph.graph.BspServiceWorker.movePartitionsToWorker(=
BspServiceWorker.java:1389)
        at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.=
java:624)
        at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458)

.

.

.


I'm not sure where the start debugging. . .BspServiceWorker is hella big.  =
All input is welcome.  As I mentioned, I'm processing a sequenceFile that h=
as Text keys and MapWritable Values.  I would like the vertices to have Tex=
t indices and MapWritable values.  (I'm not inserting any edges for the tim=
e being. . .I just want to see the file get split properly).  I have implem=
ented custom input formats and record readers.  Thx


-Dave


--_000_CB4B750C5ED8dgarciapotomacfusioncom_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html><head></head><body style=3D"word-wrap: break-word; -webkit-nbsp-mode:=
 space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-si=
ze: 14px; font-family: Calibri, sans-serif; "><div><br></div><span id=3D"OL=
K_SRC_BODY_SECTION"><div><br></div><div><div style=3D"word-wrap: break-word=
; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: r=
gb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif; "><div>Hell=
o, I get this error when I try run my job:</div><div><pre style=3D"color: r=
gb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal;=
 letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webk=
it-auto; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0=
px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><pre =
style=3D"color: rgb(0, 0, 0); font-style: normal; font-variant: normal; fon=
t-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; =
text-align: -webkit-auto; text-indent: 0px; text-transform: none; widows: 2=
; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-wi=
dth: 0px; "><pre style=3D"color: rgb(0, 0, 0); font-style: normal; font-var=
iant: normal; font-weight: normal; letter-spacing: normal; line-height: nor=
mal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform=
: none; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webk=
it-text-stroke-width: 0px; ">2012-01-29 21:50:18,494 INFO org.apache.giraph=
.graph.BspServiceWorker: reserveInputSplit: reservedPath =3D null, 1 of 1 I=
nputSplits are finished.
2012-01-29 21:50:18,494 INFO org.apache.giraph.graph.BspServiceWorker: setu=
p: Finally loaded a total of (v=3D0, e=3D0)
2012-01-29 21:50:18,764 INFO org.apache.giraph.graph.BspService: process: i=
nputSplitsAllDoneChanged (all vertices sent from input splits)
2012-01-29 21:50:18,766 ERROR org.apache.giraph.graph.GraphMapper: setup: C=
aught exception just before end of setup</pre></pre><pre style=3D"color: rg=
b(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; =
letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webki=
t-auto; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0p=
x; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">java.l=
ang.IllegalStateException: moveVerticesToWorker: Vertex Vertex(id=3DzzYNBgK=
t2LF6ClLA2eMBzuN7SkA.,value=3Dorg.apache.hadoop.io.MapWritable@5ce8787a,#ed=
ges=3D0) already exists!
	at org.apache.giraph.graph.BspServiceWorker.movePartitionsToWorker(BspServ=
iceWorker.java:1389)
	at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:62=
4)
	at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:458)</pre><p=
re style=3D"color: rgb(0, 0, 0); font-style: normal; font-variant: normal; =
font-weight: normal; letter-spacing: normal; line-height: normal; orphans: =
2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; widows=
: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke=
-width: 0px; ">.</pre><pre style=3D"color: rgb(0, 0, 0); font-style: normal=
; font-variant: normal; font-weight: normal; letter-spacing: normal; line-h=
eight: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text=
-transform: none; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: a=
uto; -webkit-text-stroke-width: 0px; ">.</pre><pre style=3D"color: rgb(0, 0=
, 0); font-style: normal; font-variant: normal; font-weight: normal; letter=
-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto=
; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -we=
bkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">.</pre><pre =
style=3D"color: rgb(0, 0, 0); font-style: normal; font-variant: normal; fon=
t-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; =
text-align: -webkit-auto; text-indent: 0px; text-transform: none; widows: 2=
; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-wi=
dth: 0px; "><br></pre><pre style=3D"color: rgb(0, 0, 0); font-style: normal=
; font-variant: normal; font-weight: normal; letter-spacing: normal; line-h=
eight: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text=
-transform: none; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: a=
uto; -webkit-text-stroke-width: 0px; ">I'm not sure where the start debuggi=
ng. . .BspServiceWorker is hella big.  All input is welcome.  As I mentione=
d, I'm processing a sequenceFile that has Text keys and MapWritable Values.=
  I would like the vertices to have Text indices and MapWritable values.  (=
I'm not inserting any edges for the time being. . .I just want to see the f=
ile get split properly).  I have implemented custom input formats and recor=
d readers.  Thx</pre><pre style=3D"color: rgb(0, 0, 0); font-style: normal;=
 font-variant: normal; font-weight: normal; letter-spacing: normal; line-he=
ight: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-=
transform: none; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: au=
to; -webkit-text-stroke-width: 0px; "><br></pre><pre style=3D"color: rgb(0,=
 0, 0); font-style: normal; font-variant: normal; font-weight: normal; lett=
er-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-au=
to; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -=
webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">-Dave</pre=
><pre style=3D"color: rgb(0, 0, 0); font-style: normal; font-variant: norma=
l; font-weight: normal; letter-spacing: normal; line-height: normal; orphan=
s: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; wid=
ows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-str=
oke-width: 0px; "><br></pre></pre></div></div></div></span></body></html>

--_000_CB4B750C5ED8dgarciapotomacfusioncom_--