hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1447) Tune memory usage of InternalCachedBag
Date Tue, 17 Aug 2010 20:50:18 GMT

    [ https://issues.apache.org/jira/browse/PIG-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899576#action_12899576
] 

Thejas M Nair commented on PIG-1447:
------------------------------------

I ran L15_modified after applying patch in PIG-1524, which gives number of bags that spilled,
and total number of records that spilled -
||query || spills with 0.1f || spills with 0.2f ||
| L15_modified | 1.2 million bags containing total of  5million records. in range of 500mb
 | 413k bags containing 3 million records . in range of 300mb|


> Tune memory usage of InternalCachedBag
> --------------------------------------
>
>                 Key: PIG-1447
>                 URL: https://issues.apache.org/jira/browse/PIG-1447
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Thejas M Nair
>             Fix For: 0.8.0
>
>         Attachments: L15_modified.pig
>
>
> We need to find a better value for "pig.cachedbag.memusage".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message