flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1514) [Gelly] Add a Gather-Sum-Apply iteration method
Date Tue, 24 Feb 2015 14:54:04 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334951#comment-14334951

ASF GitHub Bot commented on FLINK-1514:

Github user vasia commented on the pull request:

    This looks great already! We just need a few more changes: 
    - you can add the `Triplet` type inside the gsa package. This should just be a simple
wrapper around `Tuple3<VV, EV, VV>`. (I think we don't even need the Vertex IDs here,
just the values).
    - I see you have exposed the vertex keys in the UDFs. These should be hidden from the
user-facing methods, e.g. in the SSSP example `gather()` should return `Double`, not `Tuple2<Long,
Double>`, `sum()` should get two Doubles and return a Double (the minimum) and `apply()`
should get a Double (the current value) and an M (the accumulator result) and return a Double.
    More specifically, the UDFs should be defined like this:
    - `gather: Triplet -> M`
    - `sum: <M, M> -> M`
    - `apply: <VV, M> -> VV`
    Of course the wrappers inside `GatherSumApplyIteration` (`GatherUDF`, SumUDF`, `ApplyUDF`)
will have to maintain the keys. The point is to hide them from the user :)

> [Gelly] Add a Gather-Sum-Apply iteration method
> -----------------------------------------------
>                 Key: FLINK-1514
>                 URL: https://issues.apache.org/jira/browse/FLINK-1514
>             Project: Flink
>          Issue Type: New Feature
>          Components: Gelly
>    Affects Versions: 0.9
>            Reporter: Vasia Kalavri
>            Assignee: Daniel Bali
> This will be a method that implements the GAS computation model, but without the "scatter"
step. The phases can be mapped into the following steps inside a delta iteration:
> gather: a map on each < srcVertex, edge, trgVertex > that produces a partial value
> sum: a reduce that combines the partial values
> apply: join with vertex set to update the vertex values using the results of sum and
the previous state.

This message was sent by Atlassian JIRA

View raw message