Mailing-List: contact issues-help@eagle.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@eagle.incubator.apache.org
Date: Mon, 28 Nov 2016 01:55:58 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: issues@eagle.incubator.apache.org
Message-ID: <JIRA.13022130.1479718885000.374254.1480298158336@Atlassian.JIRA>
In-Reply-To: <JIRA.13022130.1479718885000@Atlassian.JIRA>
References: <JIRA.13022130.1479718885000@Atlassian.JIRA> <JIRA.13022130.1479718885167@arcas>
Subject: [jira] [Commented] (EAGLE-794) Enable publish bolt parallelism
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 28 Nov 2016 01:56:03 -0000


    [ https://issues.apache.org/jira/browse/EAGLE-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700672#comment-15700672 ] 

ASF GitHub Bot commented on EAGLE-794:
--------------------------------------

GitHub user garrettlish opened a pull request:

    https://github.com/apache/incubator-eagle/pull/687

    EAGLE-794: enable publish bolt parallelism

    Currently the publish is using shuffle grouping, we cannot enable parallelism for publish since we may have local cache which is unavailable across the storm cluster. We are going to use field group function to partition streams for publish bolt parallelism.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/garrettlish/incubator-eagle eagle794

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-eagle/pull/687.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #687
    
----
commit 505a32ae576689e9012a80346c6f005c3082de42
Author: Xiancheng Li <xiancheng.li@ebay.com>
Date:   2016-11-25T01:47:41Z

    EAGLE-794: enable publish bolt parallelism

----


> Enable publish bolt parallelism
> -------------------------------
>
>                 Key: EAGLE-794
>                 URL: https://issues.apache.org/jira/browse/EAGLE-794
>             Project: Eagle
>          Issue Type: Improvement
>    Affects Versions: v0.5.0
>            Reporter: Garrett Li
>            Assignee: Garrett Li
>             Fix For: v0.5.0
>
>
> Currently the publish is using shuffle grouping, we cannot enable parallelism for publish since we may have local cache which is unavailable across the storm cluster. 
> We are going to use the same strategy as router bolts to alert bolts, which is using field grouping (define empty list of field) and dispatch tuple according to group by fields hashing.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)