hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1394) POCombinerPackage hold too much memory for InternalCachedBag
Date Mon, 26 Apr 2010 20:56:31 GMT

     [ https://issues.apache.org/jira/browse/PIG-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai updated PIG-1394:
----------------------------

    Attachment: PIG-1394-2.patch

Previous patch miss something, attach a new one.

> POCombinerPackage hold too much memory for InternalCachedBag
> ------------------------------------------------------------
>
>                 Key: PIG-1394
>                 URL: https://issues.apache.org/jira/browse/PIG-1394
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.8.0
>
>         Attachments: PIG-1394-1.patch, PIG-1394-2.patch
>
>
> In POCombinerPackage, we create bunch of InternalCachedBag, the number of which is the
number of algebraic UDFs we use. However, when we create InternalCachedBag, we use the default
construct which assume we only create 1 InternalCachedBag in the system. It turns out we reserve
way to much memory to InternalCachedBag.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message