Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C41E61010D for ; Mon, 3 Jun 2013 19:34:54 +0000 (UTC) Received: (qmail 16054 invoked by uid 500); 3 Jun 2013 19:34:54 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 16026 invoked by uid 500); 3 Jun 2013 19:34:54 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 16018 invoked by uid 99); 3 Jun 2013 19:34:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Jun 2013 19:34:54 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [209.85.220.170] (HELO mail-vc0-f170.google.com) (209.85.220.170) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Jun 2013 19:34:50 +0000 Received: by mail-vc0-f170.google.com with SMTP id hf12so1536469vcb.29 for ; Mon, 03 Jun 2013 12:34:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=DgA+vGNVcJR9Hc7rr88WOxO9MQWM1l2/25ZbkhzpFjg=; b=RnfiBMSjEA1IIQFXY42r9iBIHPjEhisx7oN26nqhADmaQEWqKuofA3VPV33L/4HpJm OCQqTIL9U3fMW6/O9crjZ1GZrdzvQnbsSlKjixna9W247/ZEPSv8RkPq+8vG4DcE8GAz 2+0Afgs31oc8y8Bxn/1qxhW1ZEwjee4SzO5mtQFWuOcksfqRNQp9RinS8sTVn1kFUCGw uWHaolasd+oGCYcfyGHsH+rIBhYNWfMebfM6m2taIJBDEcMKh5+CylED8nrJDRpOoyLm hftMRudwrJMbPIq547gQU7H3WCivJvGtRN7KDtMBYFmH2XW8wUqSusOeUPtQkQorQa8j FTqQ== MIME-Version: 1.0 X-Received: by 10.220.85.66 with SMTP id n2mr17566684vcl.31.1370288048118; Mon, 03 Jun 2013 12:34:08 -0700 (PDT) Received: by 10.58.252.3 with HTTP; Mon, 3 Jun 2013 12:34:07 -0700 (PDT) In-Reply-To: References: Date: Mon, 3 Jun 2013 20:34:07 +0100 Message-ID: Subject: Re: SimpleShortestPathsComputation with Edge List input file From: Peter Holland To: user@giraph.apache.org Content-Type: multipart/alternative; boundary=001a11c2b9ec59312204de450c6e X-Gm-Message-State: ALoCoQmi0hWGlAEKa72rv4j6lAcRXBCg4sY7CXl05P8H1sZkfEATH4oRM6964bg2bLNJrfrPds0J X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2b9ec59312204de450c6e Content-Type: text/plain; charset=ISO-8859-1 Thank you for the advice Claudio I updated the run command to use different io classes *bin/hadoop jar /home/ubuntu/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar * * org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation * *-eif org.apache.giraph.io.EdgeInputFormat* * -eip /simpleEdgeList/SimpleEdgeList.tsv* *-of org.apache.giraph.io.formats.IdWithValueTextOutputFormat * *-op /outShortestEdgeList01 * *-w 1* * * This code does start a MapReduce job but progress stays at 0%. The log file for the job has the following IOException error; *MapAttempt TASK_TYPE="MAP" TASKID="task_201306031954_0002_m_000000" TASK_ATTEMPT_ID="attempt_201306031954_0002_m_000000_0" TASK_STATUS="FAILED" FINISH_TIME="1370282492527" HOSTNAME="ubuntu-VirtualBox" ERROR="java\.lang\.Throwable: Child Error* * at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:271)* *Caused by: java\.io\.IOException: Task process exit with nonzero status of 1\.* * at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:258)* So, this leaves 3 questions; Is the edge list file format correct? (a tab separated file with a .tsv extension) Is the input class correct? Is the output class correct? Thank you, Peter On 3 June 2013 01:05, Claudio Martella wrote: > Hi Peter, > > shortly, those are abstract classes, that's why you cannot instantiate > them. You'll have to use a specific class extending those classes that are > aware of the types of the signature of the vertex (I, V, E, M). check out > some classes in the format package that have those types in the class name. > > > On Mon, Jun 3, 2013 at 1:25 AM, Peter Holland wrote: > >> Hello, >> I'm new to Giraph and I'm trying to run SimpleShortestPathsComputation >> using an edge list input file. I have some questions and and error message >> that hopefully I can get some help with. >> >> Edge List File Format >> What is the correct format for an edge list input file? >> I have a .tsv file with a vertex represented as an integer. Is this >> correct? >> >> 5 11 >> 1 6 >> 6 9 >> 6 8 >> 8 9 >> ..... >> >> Input File Class: >> Is org.apache.giraph.io.formats.*TextEdgeInputFormat *the only input >> format that can be used for edge lists? >> >> Output File Class: >> Does the output format depend on the job you are running? I have been >> using org.apache.giraph.io.formats.*TextVertexOutputFormat* for >> SimpleShortestPathsComputation. >> >> Run Command: >> So this is the command I am using to try to run the >> SimpleShortestPathsComputation using an edge list input file. >> >> *bin/hadoop jar >> /home/ubuntu/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar >> org.apache.giraph.GiraphRunner >> org.apache.giraph.examples.SimpleShortestPathsComputation * >> *-eif org.apache.giraph.io.formats.TextEdgeInputFormat * >> *-eip /simpleEdgeList/SimpleEdgeList.tsv * >> *-of org.apache.giraph.io.formats.TextVertexOutputFormat * >> *-op /outShortest* >> *-w 3* >> >> Error Message >> When I run the above command I get the following error message: >> Exception in thread "main" java.lang.IllegalStateException: newInstance: >> Couldn't instantiate org.apache.giraph.io.formats.TextVertexOutputFormat >> >> Thank you, >> Peter >> > > > > -- > Claudio Martella > claudio.martella@gmail.com > --001a11c2b9ec59312204de450c6e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thank you for the advice Claudio

= I updated the run command to use different io classes
=
bin/hadoop jar /home/ubuntu/giraph/giraph-examples/target= /giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar= =A0
org.apache.girap= h.GiraphRunner org.apach= e.giraph.examples.SimpleShortestPathsComputation=A0
-eif <= a href=3D"http://org.apache.giraph.io">org.apache.giraph.io.EdgeInpu= tFormat
=A0-eip /simpleEdgeList/SimpleEdgeList.tsv
= -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat=A0<= /div>
-op /outShortestEdgeList01=A0
-w 1
<= div>
This code does start a MapReduce job but progre= ss stays at 0%. The log file for the job has the following IOException erro= r;

MapAttempt TASK_TYPE=3D&quo= t;MAP" TASKID=3D"task_201306031954_0002_m_000000" TASK_ATTEM= PT_ID=3D"attempt_201306031954_0002_m_000000_0" TASK_STATUS=3D&quo= t;FAILED" FINISH_TIME=3D"1370282492527" HOSTNAME=3D"ubu= ntu-VirtualBox" ERROR=3D"java\.lang\.Throwable: Child Error
at org\.apache\.= hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:271)
Caus= ed by: java\.io\.IOException: Task process exit with nonzero status of 1\.<= /i>
at org\.apache\.= hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:258)

So, this leaves 3 questions; =A0
Is the= edge list file format correct? (a tab separated file with a .tsv extension= )=A0
Is the input class correct?=A0
Is the output cla= ss correct?=A0

Thank you,
Peter




On 3 June 2013 01:05, Claudio Martella <= span dir=3D"ltr"><claudio.martella@gmail.com> wrote:
Hi Peter,

shortly, those are abstract c= lasses, that's why you cannot instantiate them. You'll have to use = a specific class extending those classes that are aware of the types of the= signature of the vertex (I, V, E, M). check out some classes in the format= package that have those types in the class name.


On Mon, Jun 3, 2013 at 1:25 AM, Peter Holland <d99991048= @mydit.ie> wrote:
Hello,=A0
I'm new to Giraph and I'm trying to run SimpleShortestPathsComputat= ion using an edge list input file. I have some questions and and error mess= age that hopefully I can get some help with.=A0
=
Edge List File Format
What is the correct format for an edge list input file?=A0
I have a .= tsv file with a vertex represented as an integer. Is this correct?=A0
=
5 11
1 6
6 9
6 8
8 = 9
.....

Input File Class:
Is org.apache.giraph.io.formats.TextEdgeInputForm= at=A0the only input format that can be used for edge lists?=A0
=
Output File Class:=A0
Does the output format depend on the job you are running? I have been using= org.apache.giraph.io.formats.TextVertexOutputFormat=A0for SimpleSho= rtestPathsComputation.

Run Command:=A0
So this is the command I am using to try to = run the SimpleShortestPathsComputation using an edge list input file.=A0
=
bin/hadoop jar /home/ubuntu/giraph/giraph-examples/target/gira= ph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar org.a= pache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsCom= putation=A0
= -eif org.apache.giraph.io.formats.TextEdgeInputFormat=A0
-eip /simpleEdgeList/SimpleEdgeList.tsv=A0
-of org.apache.gi= raph.io.formats.TextVertexOutputFormat=A0
-op /outShortest
-w 3

Error Message
When I run the above command I get th= e following error message:=A0
Exception in thread "main" java.lang.IllegalStateException: = newInstance: Couldn't instantiate org.apache.giraph.io.formats.TextVert= exOutputFormat

Thank you,
Peter=A0



--
=A0 =A0Claudio Martella
= =A0 =A0cla= udio.martella@gmail.com=A0 =A0

--001a11c2b9ec59312204de450c6e--