eagle-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (EAGLE-794) Enable publish bolt parallelism
Date Mon, 28 Nov 2016 01:55:58 GMT

    [ https://issues.apache.org/jira/browse/EAGLE-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700672#comment-15700672
] 

ASF GitHub Bot commented on EAGLE-794:
--------------------------------------

GitHub user garrettlish opened a pull request:

    https://github.com/apache/incubator-eagle/pull/687

    EAGLE-794: enable publish bolt parallelism

    Currently the publish is using shuffle grouping, we cannot enable parallelism for publish
since we may have local cache which is unavailable across the storm cluster. We are going
to use field group function to partition streams for publish bolt parallelism.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/garrettlish/incubator-eagle eagle794

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-eagle/pull/687.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #687
    
----
commit 505a32ae576689e9012a80346c6f005c3082de42
Author: Xiancheng Li <xiancheng.li@ebay.com>
Date:   2016-11-25T01:47:41Z

    EAGLE-794: enable publish bolt parallelism

----


> Enable publish bolt parallelism
> -------------------------------
>
>                 Key: EAGLE-794
>                 URL: https://issues.apache.org/jira/browse/EAGLE-794
>             Project: Eagle
>          Issue Type: Improvement
>    Affects Versions: v0.5.0
>            Reporter: Garrett Li
>            Assignee: Garrett Li
>             Fix For: v0.5.0
>
>
> Currently the publish is using shuffle grouping, we cannot enable parallelism for publish
since we may have local cache which is unavailable across the storm cluster. 
> We are going to use the same strategy as router bolts to alert bolts, which is using
field grouping (define empty list of field) and dispatch tuple according to group by fields
hashing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message