pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-4806) UDFContext can be overwritten with empty properties in the task for inputs and outputs during initialization
Date Thu, 11 Feb 2016 01:29:18 GMT

     [ https://issues.apache.org/jira/browse/PIG-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rohini Palaniswamy updated PIG-4806:
------------------------------------
    Status: Patch Available  (was: Open)

> UDFContext can be overwritten with empty properties in the task for inputs and outputs
during initialization
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: PIG-4806
>                 URL: https://issues.apache.org/jira/browse/PIG-4806
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.16.0
>
>         Attachments: PIG-4806-1.patch
>
>
> We reinitialize UDFContext ThreadLocal itself in PigProcessor.initialize(). PigProcessor.initialize()
is run in parallel with threads that do MRInput.initialize() and MROutput.initialize(). It
can overwrite the initialized values in the input and output half way through. This can lead
to exceptions if the property stored in UDFContext is mandatory and task will be retried which
is ok. If it is not mandatory and it ends up getting null when it actually had a value, wrong
data can be produced silently.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message