apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yogi Devendra <yogideven...@apache.org>
Subject Sub Partitioning the parallel partitions
Date Mon, 25 Jul 2016 16:41:59 GMT

I have a DAG A->B->C.

1. A is kafka input operator reading from 4 different topics configured
with ONE_TO_ONE strategy. Thus creating 4 partitons of A.
2. B and C are configured to have parallel partitions w.r.t. their input
port. Thus, currently both B, C have 4 partitions.

I am observing B significant latency in B operator. Thus, would like to
have 2 partitions for B per partition of A. Since, application is latency
intensive, I want to avoid unifiers as far as possible.

How to achieve this partitioning?

~ Yogi

View raw message