apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandesh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators
Date Tue, 12 Jul 2016 15:17:20 GMT

     [ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sandesh updated APEXCORE-482:
-----------------------------
    Description: 
Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL with the downstream
operator. It is better to make it THREAD_LOCAL to improve the performance.

Custom unifiers can still be CONTAINER_LOCAL and possibly allow the users to control the behaviours.

Note: Created a prototype to understand the root cause : https://github.com/sandeshh/apex-core/commit/550f31c770b704360c813924e85a9fffeaec7c53
During PhysicalPlan creation downstream operator's input port won't have stream locality assigned.
So StreamingContainerAgent assigns CONTAINER_LOCAL

Actual implementation should be done in Physical Plan.

  was:
Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL with the downstream
operator. It is better to make it THREAD_LOCAL to improve the performance.

Custom unifiers can still be CONTAINER_LOCAL and possibly allow the users to control the behaviours.

Note: Created a prototype to understand the root cause : https://github.com/sandeshh/apex-core/commit/550f31c770b704360c813924e85a9fffeaec7c53
During PhysicalPlan creation downstream operators input port won't have stream locality assigned.
So StreamingContainerAgent assigns CONTAINER_LOCAL

Actual implementation should be done in Physical Plan.


> Default Unifiers should be ThreadLocal with downstream operators
> ----------------------------------------------------------------
>
>                 Key: APEXCORE-482
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-482
>             Project: Apache Apex Core
>          Issue Type: Improvement
>            Reporter: Sandesh
>            Assignee: Sandesh
>
> Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL with the
downstream operator. It is better to make it THREAD_LOCAL to improve the performance.
> Custom unifiers can still be CONTAINER_LOCAL and possibly allow the users to control
the behaviours.
> Note: Created a prototype to understand the root cause : https://github.com/sandeshh/apex-core/commit/550f31c770b704360c813924e85a9fffeaec7c53
> During PhysicalPlan creation downstream operator's input port won't have stream locality
assigned. So StreamingContainerAgent assigns CONTAINER_LOCAL
> Actual implementation should be done in Physical Plan.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message