giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nalezenec, Lukas" <Lukas.Naleze...@firma.seznam.cz>
Subject RE: SequenceFileVertexInputFormatClass
Date Wed, 17 Jul 2013 09:48:20 GMT

Hi,
I am using

FileInputFormat.addInputPath(job.getInternalJob(), new Path(args[0]));

its not best solution but it works.
Lukas

________________________________________
Od: david [dgainer@bbn.com]
Odesláno: 16. července 2013 23:11
Komu: user@giraph.apache.org
Předmět: RE: SequenceFileVertexInputFormatClass

Actually I'm guessing that I'm just not setting the input path correctly - does this work:

GiraphConfiguration conf = job.getConfiguration();
...
GiraphFileInputFormat.addVertexInputPath(conf, new Path(args[0]));
conf.setVertexInputFormatClass(SequenceFileVertexInputFormat.class);

(in 1.1.0 snapshot)

Thanks,

David

________________________________
From: david [mailto:dgainer@bbn.com]
Sent: Tuesday, July 16, 2013 5:06 PM
To: user@giraph.apache.org
Subject: SequenceFileVertexInputFormatClass

Does anyone have a simple example of how to use it?  Do I need to extend it for my classes
or can I just use it like I would
SequenceFileInputFormat in hadoop.  I'm getting the following error;


java.lang.IllegalStateException: generateVertexInputSplits: Got IOException

        at org.apache.giraph.master.BspServiceMaster.generateInputSplits(BspServiceMaster.java:316)

        at org.apache.giraph.master.BspServiceMaster.createInputSplits(BspServiceMaster.java:626)

        at org.apache.giraph.master.BspServiceMaster.createVertexInputSplits(BspServiceMaster.java:693)

        at org.apache.giraph.master.MasterThread.run(MasterThread.java:99)

Caused by: java.io.IOException: No input paths specified in job

        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:189)

        at org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:55)

        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:248)

        at org.apache.giraph.io.formats.SequenceFileVertexInputFormat.getSplits(SequenceFileVertexInputFormat.java:52)

        at org.apache.giraph.io.internal.WrappedVertexInputFormat.getSplits(WrappedVertexInputFormat.java:66)

        at org.apache.giraph.master.BspServiceMaster.generateInputSplits(BspServiceMaster.java:314)

But I think the input path is correctly set.  Thanks, I appreciate it,

David

Mime
View raw message