tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-362) Object cache for users to re-use objects across tasks within the same container/jvm
Date Tue, 20 Aug 2013 02:11:51 GMT

    [ https://issues.apache.org/jira/browse/TEZ-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13744620#comment-13744620
] 

Bikas Saha commented on TEZ-362:
--------------------------------

Looks good.

With the last changes, concurrenthashmap is probably not needed.

It may be helpful to add a comment in the add() method that this may replace the same object
from a different lifecycle. So one can get the same object back in the return value.
                
> Object cache for users to re-use objects across tasks within the same container/jvm
> -----------------------------------------------------------------------------------
>
>                 Key: TEZ-362
>                 URL: https://issues.apache.org/jira/browse/TEZ-362
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>            Assignee: Hitesh Shah
>         Attachments: TEZ-362.2.patch, TEZ-362.3.wip.patch, TEZ-362.5.patch, TEZ-362.mrrsleepjobchanges
>
>
> Users like hive will find it useful to cache the dimension tables across tasks when container
reuse is enabled.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message