gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (GEARPUMP-52) support local shuffling
Date Wed, 20 Apr 2016 05:34:25 GMT
Manu Zhang created GEARPUMP-52:
----------------------------------

             Summary: support local shuffling
                 Key: GEARPUMP-52
                 URL: https://issues.apache.org/jira/browse/GEARPUMP-52
             Project: Apache Gearpump
          Issue Type: New Feature
          Components: streaming
            Reporter: Manu Zhang


imported from [https://github.com/gearpump/gearpump/issues/1649].



Storm has a grouping strategy called LocalOrShuffleGrouping which will have better performance
than ShuffleGrouping in theory.

{quote}
Local or shuffle grouping: If the target bolt has one or more tasks in the same worker process,
tuples will be shuffled to just those in-process tasks. Otherwise, this acts like a normal
shuffle grouping.
{quote}

This requires context information of tasks in the same Executor.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message