giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Kimbrel <lekimb...@gmail.com>
Subject Re: duplicate edges created with TextVertexInputFormat
Date Thu, 30 Jan 2014 20:07:37 GMT
I don’t see how i could possibly pass in the input file twice.  I am simple using GiraphRunner
and specifying -vif and -vip, 
the path only contains the file once.

I do agree though that it is being read in as two identical input splits.  In fact you see
this line

hdfs://arcus1.silverdale.dev/tmp/louvain-giraph-example/1390935731/input/small:0+172'

repeated exactly twice.  which is the exact same file and same offset.


Mime
View raw message