pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Praveen Rachabattuni (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4232) UDFContext is not initialized in executors when running on Spark cluster
Date Wed, 26 Nov 2014 13:25:12 GMT

    [ https://issues.apache.org/jira/browse/PIG-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226169#comment-14226169
] 

Praveen Rachabattuni commented on PIG-4232:
-------------------------------------------

Tested scripts using java and python udfs. Committed to spark branch. Thanks [~kellyzly]

> UDFContext is not initialized in executors when running on Spark cluster
> ------------------------------------------------------------------------
>
>                 Key: PIG-4232
>                 URL: https://issues.apache.org/jira/browse/PIG-4232
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Praveen Rachabattuni
>            Assignee: liyunzhang_intel
>         Attachments: PIG-4232.patch, PIG-4232_1.patch, PIG-4232_2.patch, PIG-4232_3.patch,
PIG-4232_4.patch, PIG-4232_5.patch, PIG-4232_6.patch, pouserfunc.readObject.stacktrace.txt
>
>
> UDFContext is used in lot of features across pig code base. For example its used in PigStorage
to pass columns information between the frontend and the backend code. https://github.com/apache/pig/blob/spark/src/org/apache/pig/builtin/PigStorage.java#L246-L247



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message