giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charith Wickramarachchi <charith.dhanus...@gmail.com>
Subject Re: Using a custom graph partitioning stratergy with giraph
Date Sun, 28 Sep 2014 05:51:29 GMT
Also adding some more information.

My current understanding is I should be able to do this by  my own
org.apache.giraph.partition.WorkerGraphPartitioner implementation.

But my question is, Is there are a way to get some outside input inside the
WorkerGraphPartitioner?In my case it will be an hdfs file location.

Thanks,
Charith










On Sat, Sep 27, 2014 at 10:13 PM, Charith Wickramarachchi <
charith.dhanushka@gmail.com> wrote:

> Hi,
>
> I m trying to use giraph with a custom graph partitioner that I have. In
> my case i want to assign vertices to workers based on a custom partitioner
> input.
>
> In my case partitioner will take number of workers as an input parameter
> and give me a file which maps each vertex id to a worker. I m trying load
> this file to a hdfs location and use it as an input to the giraph and do
> the vertex assignment.
>
> Any suggestions or pointers on best way to this will be highly appricated
> (Use the current extention points of giraph as much as possible to avoid
> random hacks).
>
> I m currently using giraph-1.0.0.
>
> Thanks,
> Charith
>
>
>
>
> --
> Charith Dhanushka Wickramaarachchi
>
> Tel  +1 213 447 4253
> Web  http://apache.org/~charith <http://www-scf.usc.edu/~cwickram/>
> <http://charith.wickramaarachchi.org/>
> Blog  http://charith.wickramaarachchi.org/
> <http://charithwiki.blogspot.com/>
> Twitter  @charithwiki <https://twitter.com/charithwiki>
>
> This communication may contain privileged or other confidential information
> and is intended exclusively for the addressee/s. If you are not the
> intended recipient/s, or believe that you may have
> received this communication in error, please reply to the sender indicating
> that fact and delete the copy you received and in addition, you should
> not print, copy, retransmit, disseminate, or otherwise use the
> information contained in this communication. Internet communications
> cannot be guaranteed to be timely, secure, error or virus-free. The
> sender does not accept liability for any errors or omissions
>



-- 
Charith Dhanushka Wickramaarachchi

Tel  +1 213 447 4253
Web  http://apache.org/~charith <http://www-scf.usc.edu/~cwickram/>
<http://charith.wickramaarachchi.org/>
Blog  http://charith.wickramaarachchi.org/
<http://charithwiki.blogspot.com/>
Twitter  @charithwiki <https://twitter.com/charithwiki>

This communication may contain privileged or other confidential information
and is intended exclusively for the addressee/s. If you are not the
intended recipient/s, or believe that you may have
received this communication in error, please reply to the sender indicating
that fact and delete the copy you received and in addition, you should not
print, copy, retransmit, disseminate, or otherwise use the information
contained in this communication. Internet communications cannot be
guaranteed to be timely, secure, error or virus-free. The sender does not
accept liability for any errors or omissions

Mime
View raw message