Return-Path: 
 <user-return-1574-apmail-giraph-user-archive=giraph.apache.org@giraph.apache.org>
X-Original-To: apmail-giraph-user-archive@www.apache.org
Delivered-To: apmail-giraph-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1403110D20
	for <apmail-giraph-user-archive@www.apache.org>;
 Fri,  4 Oct 2013 11:36:35 +0000 (UTC)
Received: (qmail 2920 invoked by uid 500); 4 Oct 2013 11:36:34 -0000
Delivered-To: apmail-giraph-user-archive@giraph.apache.org
Received: (qmail 2691 invoked by uid 500); 4 Oct 2013 11:36:33 -0000
Mailing-List: contact user-help@giraph.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@giraph.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@giraph.apache.org>
List-Post: <mailto:user@giraph.apache.org>
List-Id: <user.giraph.apache.org>
Reply-To: user@giraph.apache.org
Delivered-To: mailing list user@giraph.apache.org
Received: (qmail 2683 invoked by uid 99); 4 Oct 2013 11:36:32 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Oct 2013 11:36:32 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of claudio.martella@gmail.com
 designates 209.85.212.54 as permitted sender)
Received: from [209.85.212.54] (HELO mail-vb0-f54.google.com) (209.85.212.54)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Oct 2013 11:36:27 +0000
Received: by mail-vb0-f54.google.com with SMTP id q14so2316651vbe.27
        for <user@giraph.apache.org>; Fri, 04 Oct 2013 04:36:06 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        bh=e73l52ImDPeYj/WqSrw3mKMs7mjihNJpkm7MXNuRcbY=;
        b=QVw/73u5YEGP7g/Sw/NeBOMbYDMZ3dNuVhfu/QOqKDykF+LESTGAAy/3zrkrlrg7Iv
         JPhL9VApEJ8Svgntb7gOSRosKpOsPGcieTk6gvEqHEXt+0nlcy1AjUDNlF5WP0OHKce9
         rsRzM4DK+CnFNpKqDnmbuJfgCic/UdyOEk8pZwoQCxabOexzRairc0rcl5OELBXSkoxj
         eNn/sqx2kfpRgGzZz7yd3l/tqyBJI+QVUotnfsNJFkS56ocf/K56eDzugqb/Yh7vS6CN
         sISjzelkEAY5GAgc7dLj1APre+3AJ5clh9789ilKtrwIf5eQD23d6D6O64YC6MNF+1sz
         Mg3g==
X-Received: by 10.220.11.7 with SMTP id r7mr12106484vcr.12.1380886566352; Fri,
 04 Oct 2013 04:36:06 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.220.104.200 with HTTP; Fri, 4 Oct 2013 04:35:46 -0700 (PDT)
In-Reply-To: 
 <CACcaEW5XBf8p_3a4U8=BAVgaxSwfnm4OydGm8+BinUWdCzgxVQ@mail.gmail.com>
References: 
 <CACcaEW7K+az3X2mT=DzwyOrdjV3GxbkHbM=USh4ro=9q-HFODA@mail.gmail.com>
 <CACcaEW5XBf8p_3a4U8=BAVgaxSwfnm4OydGm8+BinUWdCzgxVQ@mail.gmail.com>
From: Claudio Martella <claudio.martella@gmail.com>
Date: Fri, 4 Oct 2013 13:35:46 +0200
Message-ID: 
 <CAFJOoJfdcP5LgAyk2_m53fGoEtzApyZUUM3pdJke6GNxbA-Juw@mail.gmail.com>
Subject: Re: connected components example in giraph 1.0
To: "user@giraph.apache.org" <user@giraph.apache.org>
Content-Type: multipart/alternative; boundary=001a11c3e47c433e8e04e7e8b552
X-Virus-Checked: Checked by ClamAV on apache.org

--001a11c3e47c433e8e04e7e8b552
Content-Type: text/plain; charset=ISO-8859-1

Hi,

you need to specify the vertex outputformat class (-vof option), e.g.
org.apache.giraph.io.formats.IdWithValueTextOutputFormat.


On Fri, Oct 4, 2013 at 1:06 PM, Silvio Di gregorio <
silvio.digregorio@gmail.com> wrote:

>
> Hi,
>
> I hope I have sent to the right address.
>
> i have a graph (directed and unweighted) stored in hdfs like a adjacency
> list (140Milions of edges 6Milions of vertex)
>
> node<tab>neighbors
>
> 23   2   1    3    4    3
>
> 1 999 99923 909 .......
>
> ......
>
> hadoop version Hadoop 2.0.0-cdh4.3.0 - java 1.6
>
>
> I have executed the giraph-1.0 connected components example, in this
> fashion
>
>> > hadoop jar /usr/local/giraph/giraph-examples/target/giraph-
>> examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner org.apache.giraph.examples.ConnectedComponentsVertex
>> -vif org.apache.giraph.io.formats.IntIntNullTextInputFormat -vip
>> /user/hdfs/lista_adj_txt -op connectedgiraph --workers 4
>
>
>
> and then fail with:
>
> 13/10/04 09:28:29 INFO utils.ConfigurationUtils: No edge input format
> specified. Ensure your InputFormat does not require one.
>
>
>
> 13/10/04 09:28:29 INFO utils.ConfigurationUtils: No output format
> specified. Ensure your OutputFormat does not require one.
>
>
>
> 13/10/04 09:28:30 INFO job.GiraphJob: run: Since checkpointing is disabled
> (default), do not allow any task retries (setting mapred.map.max.attempts =
> 0, old value = 4)
>
>
>
> 13/10/04 09:28:31 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
>
>
>
> 13/10/04 09:28:31 INFO mapred.JobClient: Cleaning up the staging area
> hdfs://
> srv-bigdata-dev-01.int.sose.it:8020/user/hdfs/.staging/job_201309181636_0535
>
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found
> interface org.apache.hadoop.mapreduce.JobContext, but class was expected
>
>         at
> org.apache.giraph.bsp.BspOutputFormat.checkOutputSpecs(BspOutputFormat.java:43)
>
>         ......
>
>
>
>
>
> Thanks in advance
>
>


-- 
   Claudio Martella
   claudio.martella@gmail.com

--001a11c3e47c433e8e04e7e8b552
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div><br></div><div>you need to specify the vertex outp=
utformat class (-vof option), e.g. org.apache.giraph.io.formats.IdWithValue=
TextOutputFormat.</div>







</div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Fri,=
 Oct 4, 2013 at 1:06 PM, Silvio Di gregorio <span dir=3D"ltr">&lt;<a href=
=3D"mailto:silvio.digregorio@gmail.com" target=3D"_blank">silvio.digregorio=
@gmail.com</a>&gt;</span> wrote:<br>

<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr"><br><span style=3D"font-fam=
ily:arial,sans-serif;font-size:13px">Hi,</span><br><div class=3D"gmail_quot=
e"><div dir=3D"ltr">

<p style=3D"font-family:arial,sans-serif;font-size:13px"><span lang=3D"EN-U=
S">I hope I have sent to the right address.</span></p>
<p style=3D"font-family:arial,sans-serif;font-size:13px">
<span lang=3D"EN-US">i have a graph (directed and unweighted) stored in hdf=
s like a adjacency list (140Milions of edges 6Milions of vertex)</span></p>=
<p style=3D"font-family:arial,sans-serif;font-size:13px">node&lt;tab&gt;nei=
ghbors</p>



<p style=3D"font-family:arial,sans-serif;font-size:13px">23 =A0 2 =A0 1 =A0=
 =A03 =A0 =A04 =A0 =A03</p><p style=3D"font-family:arial,sans-serif;font-si=
ze:13px"><a href=3D"tel:1%20999%2099923" value=3D"+39199999923" target=3D"_=
blank">1 999 99923</a> 909 .......</p>


<p style=3D"font-family:arial,sans-serif;font-size:13px">
......</p><p style=3D"font-family:arial,sans-serif;font-size:13px">hadoop v=
ersion Hadoop 2.0.0-cdh4.3.0 - java 1.6<br></p><p style=3D"font-family:aria=
l,sans-serif;font-size:13px"><br></p><p style=3D"font-family:arial,sans-ser=
if;font-size:13px">



I have executed the giraph-1.0 connected components example, in this fashio=
n</p><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bo=
rder-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:so=
lid;padding-left:1ex">



<span lang=3D"EN-US">&gt;=A0</span><span style=3D"font-family:Arial,sans-se=
rif;font-size:10.5pt;line-height:13.5pt">hadoop jar /usr/local/giraph/girap=
h-</span><span style=3D"font-family:Arial,sans-serif;font-size:10.5pt;line-=
height:13.5pt">examples/target/giraph-</span><span style=3D"font-family:Ari=
al,sans-serif;font-size:10.5pt;line-height:13.5pt">examples-1.0.0-for-hadoo=
p-</span><a href=3D"tel:0.20.203.0" value=3D"+390202030" style=3D"font-fami=
ly:Arial,sans-serif;font-size:10.5pt;line-height:13.5pt" target=3D"_blank">=
0.20.203.0</a><span style=3D"font-family:Arial,sans-serif;font-size:10.5pt;=
line-height:13.5pt">-jar-with-</span><span style=3D"font-family:Arial,sans-=
serif;font-size:10.5pt;line-height:13.5pt">dependencies.jar org.apache.gira=
ph.GiraphRunner org.apache.giraph.examples.</span><span style=3D"font-famil=
y:Arial,sans-serif;font-size:10.5pt;line-height:13.5pt">ConnectedComponents=
Vertex -vif org.apache.giraph.io.formats.</span><span style=3D"font-family:=
Arial,sans-serif;font-size:10.5pt;line-height:13.5pt">IntIntNullTextInputFo=
rmat -vip /user/hdfs/lista_adj_txt -op connectedgiraph --workers 4</span></=
blockquote>



<p style=3D"font-family:arial,sans-serif;font-size:13px;margin:0cm 0cm 12pt=
;line-height:13.5pt;vertical-align:baseline"><span lang=3D"EN-US" style=3D"=
font-size:10.5pt;font-family:Arial,sans-serif">=A0</span></p><p style=3D"fo=
nt-family:arial,sans-serif;font-size:13px;margin:0cm 0cm 12pt;line-height:1=
3.5pt;vertical-align:baseline">



<span lang=3D"EN-US" style=3D"font-size:10.5pt;font-family:Arial,sans-serif=
">and then fail with:</span></p><p style=3D"font-family:arial,sans-serif;fo=
nt-size:13px;line-height:13.5pt;background-color:rgb(238,238,238);vertical-=
align:baseline">



<span lang=3D"EN-US" style=3D"font-size:10.5pt;font-family:Consolas">13/10/=
04 09:28:29 INFO utils.ConfigurationUtils: No edge input format specified. =
Ensure your InputFormat does not require one.</span></p><p style=3D"font-fa=
mily:arial,sans-serif;font-size:13px;line-height:13.5pt;background-color:rg=
b(238,238,238);vertical-align:baseline">



<span lang=3D"EN-US" style=3D"font-size:10.5pt;font-family:Consolas">=A0</s=
pan></p><p style=3D"font-family:arial,sans-serif;font-size:13px;line-height=
:13.5pt;background-color:rgb(238,238,238);vertical-align:baseline"><span la=
ng=3D"EN-US" style=3D"font-size:10.5pt;font-family:Consolas">13/10/04 09:28=
:29 INFO utils.ConfigurationUtils: No output format specified. Ensure your =
OutputFormat does not require one.</span></p>



<p style=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;=
background-color:rgb(238,238,238);vertical-align:baseline"><span lang=3D"EN=
-US" style=3D"font-size:10.5pt;font-family:Consolas">=A0</span></p><p style=
=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;backgrou=
nd-color:rgb(238,238,238);vertical-align:baseline">



<span lang=3D"EN-US" style=3D"font-size:10.5pt;font-family:Consolas">13/10/=
04 09:28:30 INFO job.GiraphJob: run: Since checkpointing is disabled (defau=
lt), do not allow any task retries (setting mapred.map.max.attempts =3D 0, =
old value =3D 4)</span></p>



<p style=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;=
background-color:rgb(238,238,238);vertical-align:baseline"><span lang=3D"EN=
-US" style=3D"font-size:10.5pt;font-family:Consolas">=A0</span></p><p style=
=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;backgrou=
nd-color:rgb(238,238,238);vertical-align:baseline">



<span lang=3D"EN-US" style=3D"font-size:10.5pt;font-family:Consolas">13/10/=
04 09:28:31 WARN mapred.JobClient: Use GenericOptionsParser for parsing the=
 arguments. Applications should implement Tool for the same.</span></p><p s=
tyle=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;back=
ground-color:rgb(238,238,238);vertical-align:baseline">



<span lang=3D"EN-US" style=3D"font-size:10.5pt;font-family:Consolas">=A0</s=
pan></p><p style=3D"font-family:arial,sans-serif;font-size:13px;line-height=
:13.5pt;background-color:rgb(238,238,238);vertical-align:baseline"><span la=
ng=3D"EN-US" style=3D"font-size:10.5pt;font-family:Consolas">13/10/04 09:28=
:31 INFO mapred.JobClient: Cleaning up the staging area hdfs://<a href=3D"h=
ttp://srv-bigdata-dev-01.int.sose.it:8020/user/hdfs/.staging/job_2013091816=
36_0535" target=3D"_blank">srv-bigdata-dev-01.int.sose.it:8020/user/hdfs/.s=
taging/job_201309181636_0535</a></span></p>



<p style=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;=
background-color:rgb(238,238,238);vertical-align:baseline"><span lang=3D"EN=
-US" style=3D"font-size:10.5pt;font-family:Consolas">Exception in thread &q=
uot;main&quot; java.lang.IncompatibleClassChangeError: Found interface org.=
apache.hadoop.mapreduce.JobContext, but class was expected</span></p>



<p style=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;=
background-color:rgb(238,238,238);vertical-align:baseline"><span lang=3D"EN=
-US" style=3D"font-size:10.5pt;font-family:Consolas">=A0=A0=A0=A0=A0=A0=A0 =
at org.apache.giraph.bsp.BspOutputFormat.checkOutputSpecs(BspOutputFormat.j=
ava:43)</span></p>



<p style=3D"font-family:arial,sans-serif;font-size:13px;line-height:13.5pt;=
background-color:rgb(238,238,238);vertical-align:baseline"><span lang=3D"EN=
-US" style=3D"font-size:10.5pt;font-family:Consolas">=A0=A0=A0=A0=A0=A0=A0=
=A0</span><span style=3D"font-size:10.5pt;font-family:Consolas">......</spa=
n><span style=3D"font-size:10.5pt;font-family:Consolas"></span></p>



<p style=3D"font-family:arial,sans-serif;font-size:13px;margin:0cm 0cm 12pt=
;line-height:13.5pt;vertical-align:baseline"><span lang=3D"EN-US" style=3D"=
font-size:10.5pt;font-family:Arial,sans-serif">=A0</span></p><p style=3D"fo=
nt-family:arial,sans-serif;font-size:13px;margin:0cm 0cm 12pt;line-height:1=
3.5pt;vertical-align:baseline">



<span lang=3D"EN-US" style=3D"font-size:10.5pt;font-family:Arial,sans-serif=
">=A0</span></p><p style=3D"font-family:arial,sans-serif;font-size:13px;mar=
gin:0cm 0cm 12pt;line-height:13.5pt;vertical-align:baseline"><span lang=3D"=
EN-US" style=3D"font-size:10.5pt;font-family:Arial,sans-serif">Thanks in ad=
vance</span></p>



</div>
</div><br></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br> =A0 =A0Clau=
dio Martella<br> =A0 =A0<a href=3D"mailto:claudio.martella@gmail.com" targe=
t=3D"_blank">claudio.martella@gmail.com</a>=A0 =A0
</div>

--001a11c3e47c433e8e04e7e8b552--