pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3456) Reduce threadlocal conf access in backend for each record
Date Fri, 24 Oct 2014 22:07:34 GMT

    [ https://issues.apache.org/jira/browse/PIG-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183616#comment-14183616
] 

Rohini Palaniswamy commented on PIG-3456:
-----------------------------------------

+1

> Reduce threadlocal conf access in backend for each record
> ---------------------------------------------------------
>
>                 Key: PIG-3456
>                 URL: https://issues.apache.org/jira/browse/PIG-3456
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.11.1
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.14.0
>
>         Attachments: PIG-3456-1-no-whitespace.patch, PIG-3456-1.patch, PIG-3456-2.patch,
PIG-3456-3.patch, PIG-3456-fixtest.patch
>
>
> Noticed few things while browsing code
> 1) DefaultTuple has a protected boolean isNull = false; which is never used. Removing
this gives ~3-5% improvement for big jobs
> 2) Config checking with ThreadLocal conf is repeatedly done for each record. For eg:
createDataBag in POCombinerPackage. But initialized only for first time in other places like
POPackage, POJoinPackage, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message