spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Takeshi Yamamuro <linguin....@gmail.com>
Subject Re: GraphX optimizations
Date Mon, 07 Mar 2016 03:42:38 GMT
Hi,

mapReduceTriplets you said has been removed in master and you need to use a
newer api,
aggregateMessages, instead of it (See SPARK-3936 and SPARK-12995 for
details).
The memory-based shuffling opt. is a topic of not only graphx but also
spark itself.
You can see SPARK-3376 for related discussions.

Thanks,


On Sat, Mar 5, 2016 at 2:53 AM, Khaled Ammar <khaled.ammar@gmail.com> wrote:

> Hi all,
>
> I wonder if the optimizations mentioned in the GraphX paper (
> https://amplab.cs.berkeley.edu/wp-content/uploads/2014/09/graphx.pdf )
> are currently implemented. In particular, I am looking for mrTriplets
> optimizations and memory-based shuffle.
>
> --
> Thanks,
> -Khaled
>



-- 
---
Takeshi Yamamuro

Mime
View raw message