flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Greg Hogan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-6648) Transforms for Gelly examples
Date Fri, 19 May 2017 19:59:04 GMT
Greg Hogan created FLINK-6648:

             Summary: Transforms for Gelly examples
                 Key: FLINK-6648
                 URL: https://issues.apache.org/jira/browse/FLINK-6648
             Project: Flink
          Issue Type: Improvement
          Components: Gelly
    Affects Versions: 1.4.0
            Reporter: Greg Hogan
            Assignee: Greg Hogan
             Fix For: 1.4.0

A primary objective of the Gelly examples {{Runner}} is to make adding new inputs and algorithms
as simple and powerful as possible. A recent feature made it possible to translate the key
ID of generated graphs to alternative numeric or string representations. For floating point
and {{LongValue}} it is desirable to translate the key ID of the algorithm results.

Currently a {{Runner}} job consists of an input, an algorithm, and an output. A {{Transform}}
will translate the input {{Graph}} and the algorithm output {{DataSet}}. The {{Input}} and
algorithm {{Driver}} will return an ordered list of {{Transform}} which will be executed in
that order (processed in reverse order for algorithm output) . The {{Transform}} can be configured
as are inputs and drivers.

Example transforms:
- the aforementioned translation of key ID types
- surrogate types (String -> Long or Int) for user data
- FLINK-4481 Maximum results for pairwise algorithms
- FLINK-3625 Graph algorithms to permute graph labels and edges

This message was sent by Atlassian JIRA

View raw message