apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yogi Devendra (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXCORE-501) Sub Partitioning the parallel partitions
Date Fri, 05 Aug 2016 05:46:20 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408917#comment-15408917

Yogi Devendra commented on APEXCORE-501:

Link for the discussion: https://lists.apache.org/thread.html/df591140a7f50a7bd9f1d7bc41fe29a93c83a13a645329f5301eebf7@%3Cusers.apex.apache.org%3E

> Sub Partitioning the parallel partitions
> ----------------------------------------
>                 Key: APEXCORE-501
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-501
>             Project: Apache Apex Core
>          Issue Type: New Feature
>            Reporter: Yogi Devendra
> Hi,
> I have a DAG A->B->C.
> 1. A is kafka input operator reading from 4 different topics configured with ONE_TO_ONE
strategy. Thus creating 4 partitons of A.
> 2. B and C are configured to have parallel partitions w.r.t. their input port. Thus,
currently both B, C have 4 partitions.
> I am observing B significant latency in B operator. Thus, would like to have 2 partitions
for B per partition of A. Since, application is latency intensive, I want to avoid unifiers
as far as possible.
> How to achieve this partitioning?

This message was sent by Atlassian JIRA

View raw message